00010000:00010000:0.0F:1787096510.001633:0:5753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0F:1787096510.257764:0:3295:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9db2bfc99500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6fcd7dc5-8395-4e52-9587-0c2c9aa0341c:3295:1873906353886208:0@lo:400:kworker.0 00000100:00100000:1.0F:1787096510.257794:0:3297:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9db2bfc98000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3297:1873906353886464:0@lo:400:kworker.0 00000100:00100000:3.0:1787096510.257886:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787096510.257887:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787096510.257980:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9db2bfc9b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1873906353886592:0@lo:400:kworker.0 00000100:00100000:3.0:1787096510.257985:0:3295:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9db2bfc9b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3295:1873906353886720:0@lo:400:kworker.0 00000100:00100000:3.0:1787096510.258041:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787096510.258045:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787096510.258097:0:3296:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9db2bfc98380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3296:1873906353886336:0@lo:400:kworker.0 00000100:00100000:0.0:1787096510.258121:0:7838:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353886592 00000100:00100000:3.0:1787096510.258131:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787096510.258131:0:7838:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353886592 00000100:00100000:3.0:1787096510.258168:0:3296:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9db2bfc98700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1873906353886848:0@lo:400:kworker.0 00000100:00100000:0.0:1787096510.258192:0:7838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1787096510.258200:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787096510.258207:0:7838:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9db286397800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3294:x1873906353886592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787096510.258236:0:3296:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787096510.258245:0:3296:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9db286395500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1873906353886976:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787096510.258290:0:7838:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9db286397800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3294:x1873906353886592:12345-0@lo:400:kworker.0 Request processed in 86us (254us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096510.258300:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787096510.258311:0:7838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1787096510.258338:0:7838:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353886848 00000100:00100000:0.0:1787096510.258342:0:7838:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353886848 00000100:00100000:3.0:1787096510.258369:0:5759:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353886208 00000100:00100000:3.0:1787096510.258376:0:5759:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353886208 00000100:00100000:0.0:1787096510.258386:0:7838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1787096510.258398:0:7838:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9db2b44efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3296:x1873906353886848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787096510.258441:0:5759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:0.0:1787096510.258455:0:7838:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9db2b44efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3296:x1873906353886848:12345-0@lo:400:kworker.0 Request processed in 57us (251us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096510.258456:0:5759:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9db2a0663850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6fcd7dc5-8395-4e52-9587-0c2c9aa0341c+18:3295:x1873906353886208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787096510.258477:0:7838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00080000:0.0:1787096510.258534:0:5760:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787096510.258570:0:5759:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9db2a0663850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6fcd7dc5-8395-4e52-9587-0c2c9aa0341c+18:3295:x1873906353886208:12345-0@lo:400:kworker.0 Request processed in 119us (691us total) trans 0 rc 0/0 00000100:00100000:0.0:1787096510.258579:0:3294:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9db2bfc9b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1873906353886592:0@lo:400:kworker.0 00000100:00100000:3.0:1787096510.258586:0:5759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:3.0:1787096510.258646:0:7424:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353886464 00000100:00100000:0.0:1787096510.258650:0:5764:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353886720 00000100:00100000:3.0:1787096510.258651:0:7424:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353886464 00000100:00100000:0.0:1787096510.258660:0:5764:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353886720 00000100:00100000:3.0:1787096510.258696:0:7424:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353886336 00000100:00100000:3.0:1787096510.258699:0:7424:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353886336 00000100:00100000:0.0:1787096510.258716:0:5764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1787096510.258728:0:5764:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9db2bfc99f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3297:x1873906353886464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787096510.258748:0:7424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1787096510.258760:0:7424:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9db2b44ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3295:x1873906353886720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787096510.258798:0:5764:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9db2bfc99f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3297:x1873906353886464:12345-0@lo:400:kworker.0 Request processed in 72us (918us total) trans 0 rc 0/0 00000100:00100000:0.0:1787096510.258806:0:5764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1787096510.258821:0:7424:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9db2b44ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3295:x1873906353886720:12345-0@lo:400:kworker.0 Request processed in 63us (781us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096510.258831:0:7424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1787096510.258910:0:3297:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9db2bfc98000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3297:1873906353886464:0@lo:400:kworker.0 00000100:00100000:0.0:1787096510.259415:0:5764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1787096510.259434:0:5764:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9db2b44eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3296:x1873906353886336:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1787096510.259473:0:5760:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787096510.259491:0:6541:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353886976 00000100:00100000:1.0:1787096510.259497:0:6541:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353886976 00000100:00100000:0.0:1787096510.259537:0:5764:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9db2b44eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3296:x1873906353886336:12345-0@lo:400:kworker.0 Request processed in 76us (1368us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096510.259544:0:3295:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9db2bfc9b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3295:1873906353886720:0@lo:400:kworker.0 00000100:00100000:0.0:1787096510.259552:0:5764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1787096510.259574:0:3295:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9db2bfc99500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6fcd7dc5-8395-4e52-9587-0c2c9aa0341c:3295:1873906353886208:0@lo:400:kworker.0 00000100:00100000:1.0:1787096510.259585:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1787096510.259596:0:6541:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9db2b44edf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3296:x1873906353886976:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787096510.259632:0:6541:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787096510.259648:0:3296:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9db2bfc98380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3296:1873906353886336:0@lo:400:kworker.0 00010000:00080000:0.0:1787096510.259678:0:3296:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9db2bfc98700 x1873906353886848/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787096526 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787096510.259687:0:6541:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9db2b44edf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3296:x1873906353886976:12345-0@lo:13:osp-pre-1-0.0 Request processed in 91us (1392us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096510.259708:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1787096510.259708:0:3296:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9db2bfc98700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1873906353886848:0@lo:400:kworker.0 00010000:00080000:0.0:1787096510.259765:0:3296:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9db286395500 x1873906353886976/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787096526 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787096510.259783:0:3296:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9db286395500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1873906353886976:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0F:1787096510.265268:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787096510.265338:0:7424:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906345479680 00000100:00100000:3.0:1787096510.265345:0:7424:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906345479680 00000100:00100000:3.0:1787096510.265402:0:7424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 106 00000100:00100000:3.0:1787096510.265409:0:7424:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9db28371b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7354022b-ee92-4e63-a611-5f745ec24594+7:25301:x1873906345479680:12345-192.168.203.45@tcp:101:rm.0 00010000:00010000:3.0:1787096510.265427:0:7424:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787096510.265443:0:7424:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9db2a23eae00/0xdf123ee4d633568 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93bbba3c5a0d8399 expref: -99 pid: 7424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096510.265491:0:7424:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9db2a23eac00/0xdf123ee4d63356f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096510.265530:0:7424:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9db2a23eac00/0xdf123ee4d63356f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096510.265541:0:7424:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9db2a23eac00/0xdf123ee4d63356f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7424 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1787096510.265543:0:5760:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00200000:3.0:1787096510.265588:0:7424:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1787096510.265591:0:7424:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:3.0:1787096510.265611:0:7424:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9db2a23eac00/0xdf123ee4d63356f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096510.265634:0:7424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9db2a23eae00/0xdf123ee4d633568 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.45@tcp remote: 0x93bbba3c5a0d8399 expref: 9 pid: 7424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096510.265653:0:7424:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9db2a23eac00/0xdf123ee4d63356f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.45@tcp remote: 0x93bbba3c5a0d8399 expref: 8 pid: 7424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096510.265669:0:7424:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9db284b25b00) 00010000:00010000:3.0:1787096510.265672:0:7424:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787096510.265676:0:7424:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9db2a23eac00, rc 0) 00000100:00100000:3.0:1787096510.265746:0:7424:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9db28371b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7354022b-ee92-4e63-a611-5f745ec24594+8:25301:x1873906345479680:12345-192.168.203.45@tcp:101:rm.0 Request processed in 326us (472us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096510.265753:0:7424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 106 00000100:00100000:2.0:1787096510.267045:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:2.0:1787096510.267081:0:5763:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906345479808 00000100:00100000:2.0:1787096510.267100:0:5763:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906345479808 00000100:00100000:2.0:1787096510.267149:0:5763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 107 00000100:00100000:2.0:1787096510.267167:0:5763:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9db28371a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7354022b-ee92-4e63-a611-5f745ec24594+8:25301:x1873906345479808:12345-192.168.203.45@tcp:101:rm.0 00010000:00010000:2.0:1787096510.267188:0:5763:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787096510.267206:0:5763:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9db2b7a0be00/0xdf123ee4d633576 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93bbba3c5a0d83a0 expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096510.267273:0:5763:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9db2b7a0a200/0xdf123ee4d63357d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096510.267287:0:5763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9db2b7a0a200/0xdf123ee4d63357d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096510.267298:0:5763:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9db2b7a0a200/0xdf123ee4d63357d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096510.267321:0:5763:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9db2b7a0a000/0xdf123ee4d633584 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf93a678a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096510.267328:0:5763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9db2b7a0a000/0xdf123ee4d633584 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf93a678a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096510.267335:0:5763:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9db2b7a0a000/0xdf123ee4d633584 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf93a678a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096510.267456:0:5763:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9db2b7a0aa00/0xdf123ee4d63358b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096510.267465:0:5763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9db2b7a0aa00/0xdf123ee4d63358b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096510.267492:0:5763:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9db2b7a0aa00/0xdf123ee4d63358b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5763 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787096510.267617:0:5763:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000401:0xd:0x0]: returning size 0 00000004:00200000:2.0:1787096510.267621:0:5763:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787096510.267639:0:5763:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9db2b7a0aa00/0xdf123ee4d63358b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096510.267651:0:5763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9db2b7a0aa00/0xdf123ee4d63358b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096510.267660:0:5763:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9db2b7a0a200/0xdf123ee4d63357d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096510.267667:0:5763:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9db2b7a0a200/0xdf123ee4d63357d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096510.267674:0:5763:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9db2b7a0a200/0xdf123ee4d63357d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096510.267681:0:5763:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9db2b7a0a200 already unused, calling callback (ffffffffc205b4f0) 00010000:00010000:2.0:1787096510.267686:0:5763:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9db2b7a0a200/0xdf123ee4d63357d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096510.267695:0:5763:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9db2b7a0a200/0xdf123ee4d63357d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096510.267721:0:5763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9db284b25b00) 00010000:00010000:2.0:1787096510.267725:0:5763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787096510.267731:0:5763:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9db2b7a0a200/0xdf123ee4d63357d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096510.267757:0:5763:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9db2b7a0a200/0xdf123ee4d63357d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096510.267769:0:5763:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9db2b7a0a000/0xdf123ee4d633584 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf93a678a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096510.267775:0:5763:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9db2b7a0a000/0xdf123ee4d633584 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf93a678a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096510.267781:0:5763:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9db2b7a0a000/0xdf123ee4d633584 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf93a678a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096510.267787:0:5763:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9db2b7a0a000 already unused, calling callback (ffffffffc205b4f0) 00010000:00010000:2.0:1787096510.267790:0:5763:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9db2b7a0a000/0xdf123ee4d633584 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf93a678a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096510.267796:0:5763:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9db2b7a0a000/0xdf123ee4d633584 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf93a678a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096510.267805:0:5763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf93a678a (ffff9db282c28c00) 00010000:00010000:2.0:1787096510.267809:0:5763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787096510.267812:0:5763:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9db2b7a0a000/0xdf123ee4d633584 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf93a678a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096510.267823:0:5763:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9db2b7a0a000/0xdf123ee4d633584 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf93a678a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096510.267860:0:5763:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9db2b7a0be00/0xdf123ee4d633576 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.45@tcp remote: 0x93bbba3c5a0d83a0 expref: 10 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096510.267875:0:5763:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9db2b7a0aa00/0xdf123ee4d63358b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.45@tcp remote: 0x93bbba3c5a0d83a0 expref: 9 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096510.267888:0:5763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9db282c28200) 00010000:00010000:2.0:1787096510.267899:0:5763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787096510.267902:0:5763:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9db2b7a0aa00, rc 0) 00000100:00100000:2.0:1787096510.267958:0:5763:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9db28371a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7354022b-ee92-4e63-a611-5f745ec24594+9:25301:x1873906345479808:12345-192.168.203.45@tcp:101:rm.0 Request processed in 792us (919us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096510.267966:0:5763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 107 00000100:00100000:1.0:1787096510.270358:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:2.0:1787096510.270435:0:5764:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906345480064 00000100:00100000:2.0:1787096510.270442:0:5764:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906345480064 00000100:00100000:2.0:1787096510.270540:0:5764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 108 00000100:00100000:2.0:1787096510.270551:0:5764:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9db2bfc98000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7354022b-ee92-4e63-a611-5f745ec24594+9:25301:x1873906345480064:12345-192.168.203.45@tcp:36:rm.0 00010000:00010000:2.0:1787096510.270602:0:5764:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1787096510.270620:0:5764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9db2b7a0aa00/0xdf123ee4d63358b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.45@tcp remote: 0x93bbba3c5a0d83a0 expref: 9 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096510.270636:0:5764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9db282c28200) 00010000:00010000:2.0:1787096510.270650:0:5764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9db2a23eac00/0xdf123ee4d63356f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.45@tcp remote: 0x93bbba3c5a0d8399 expref: 8 pid: 7424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096510.270673:0:5764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9db284b25b00) 00010000:00010000:2.0:1787096510.270680:0:5764:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787096510.270695:0:5764:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9db2b7a0a400/0xdf123ee4d633592 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096510.270703:0:5764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9db2b7a0a400/0xdf123ee4d633592 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096510.270709:0:5764:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9db2b7a0a400/0xdf123ee4d633592 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096510.270722:0:5764:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9db2b7a0a600/0xdf123ee4d633599 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xf93a678a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096510.270726:0:5764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9db2b7a0a600/0xdf123ee4d633599 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xf93a678a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096510.270730:0:5764:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9db2b7a0a600/0xdf123ee4d633599 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xf93a678a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096510.270836:0:5764:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9db2b7a0bc00/0xdf123ee4d6335a0 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096510.270845:0:5764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9db2b7a0bc00/0xdf123ee4d6335a0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096510.270852:0:5764:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9db2b7a0bc00/0xdf123ee4d6335a0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096510.271420:0:5764:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9db2b7a0b400/0xdf123ee4d6335a7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096510.271431:0:5764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9db2b7a0b400/0xdf123ee4d6335a7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096510.271439:0:5764:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9db2b7a0b400/0xdf123ee4d6335a7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096510.271446:0:5764:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9db2b7a0b400/0xdf123ee4d6335a7 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096510.271450:0:5764:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9db2b7a0b400/0xdf123ee4d6335a7 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096510.271462:0:5764:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9db2b7a0b400/0xdf123ee4d6335a7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096510.271481:0:5764:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787096510.271496:0:5764:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9db2b7a0bc00/0xdf123ee4d6335a0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096510.271514:0:5764:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9db2b7a0bc00/0xdf123ee4d6335a0 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096510.271519:0:5764:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9db2b7a0bc00/0xdf123ee4d6335a0 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096510.271524:0:5764:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9db2b7a0bc00 already unused, calling callback (ffffffffc205b4f0) 00010000:00010000:2.0:1787096510.271527:0:5764:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9db2b7a0bc00/0xdf123ee4d6335a0 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096510.271532:0:5764:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9db2b7a0bc00/0xdf123ee4d6335a0 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096510.271540:0:5764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9db282c28500) 00010000:00010000:2.0:1787096510.271543:0:5764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1787096510.271548:0:5764:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9db2b7a0bc00/0xdf123ee4d6335a0 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096510.271554:0:5764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9db2b7a0bc00/0xdf123ee4d6335a0 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096510.271564:0:6553:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787096510.271574:0:5764:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9db2b7a0a400/0xdf123ee4d633592 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096510.271575:0:6553:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9db2b7a0b400/0xdf123ee4d6335a7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096510.271593:0:6553:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9db2b7a0b400 already unused, calling callback (ffffffffc16156f0) 00010000:00010000:2.0:1787096510.271593:0:5764:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9db2b7a0a400/0xdf123ee4d633592 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096510.271597:0:6553:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9db2b7a0b400/0xdf123ee4d6335a7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096510.271614:0:6553:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9db2b7a0b400/0xdf123ee4d6335a7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096510.271616:0:5764:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9db2b7a0a400/0xdf123ee4d633592 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096510.271632:0:5764:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9db2b7a0a400 already unused, calling callback (ffffffffc205b4f0) 00010000:00010000:2.0:1787096510.271635:0:5764:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9db2b7a0a400/0xdf123ee4d633592 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096510.271636:0:6553:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9db282c28500) 00010000:00010000:3.0:1787096510.271643:0:6553:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787096510.271647:0:6553:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9db2b7a0b400/0xdf123ee4d6335a7 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096510.271649:0:5764:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9db2b7a0a400/0xdf123ee4d633592 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096510.271664:0:6553:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9db2b7a0b400/0xdf123ee4d6335a7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096510.271666:0:5764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9db282c28f00) 00010000:00010000:2.0:1787096510.271671:0:5764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787096510.271675:0:5764:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9db2b7a0a400/0xdf123ee4d633592 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096510.271683:0:5764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9db2b7a0a400/0xdf123ee4d633592 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096510.271687:0:6553:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787096510.271690:0:6553:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787096510.271693:0:6553:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00010000:2.0:1787096510.271700:0:5764:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 0000000052af6d98 reply state 00000000a4f631a1 transno 4294967341 ns: mdt-lustre-MDT0000_UUID lock: ffff9db2b7a0a600/0xdf123ee4d633599 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xf93a678a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5764 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787096510.271710:0:5764:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787096510.271800:0:5764:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9db2bfc98000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7354022b-ee92-4e63-a611-5f745ec24594+9:25301:x1873906345480064:12345-192.168.203.45@tcp:36:rm.0 Request processed in 1251us (1464us total) trans 4294967341 rc 0/0 00000100:00100000:2.0:1787096510.271806:0:5764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 108 00010000:00010000:3.0:1787096510.273146:0:3281:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9db2b7a0a600/0xdf123ee4d633599 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xf93a678a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096510.273163:0:3281:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9db2b7a0a600/0xdf123ee4d633599 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xf93a678a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096510.273171:0:3281:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9db2b7a0a600/0xdf123ee4d633599 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xf93a678a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096510.273177:0:3281:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9db2b7a0a600 already unused, calling callback (ffffffffc205b4f0) 00010000:00010000:3.0:1787096510.273180:0:3281:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9db2b7a0a600/0xdf123ee4d633599 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xf93a678a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096510.273187:0:3281:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9db2b7a0a600/0xdf123ee4d633599 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xf93a678a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096510.273202:0:3281:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf93a678a (ffff9db282c28400) 00010000:00010000:3.0:1787096510.273206:0:3281:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787096510.273210:0:3281:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9db2b7a0a600/0xdf123ee4d633599 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xf93a678a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096510.273215:0:3281:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9db2b7a0a600/0xdf123ee4d633599 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xf93a678a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096511.025597:0:8214:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787096512.049650:0:5752:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787096512.978147:0:20830:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-ec test 6b: EC write selects data mirror, not parity mirror ========================================================== 19:41:52 (1787096512) 00000100:00100000:1.0:1787096513.034807:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787096513.034872:0:5795:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906345480192 00000100:00100000:3.0:1787096513.034882:0:5795:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906345480192 00000100:00100000:3.0:1787096513.034949:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 109 00000100:00100000:3.0:1787096513.034960:0:5795:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9db2bfc9b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7354022b-ee92-4e63-a611-5f745ec24594+8:25593:x1873906345480192:12345-192.168.203.45@tcp:101:lfs.0 00000100:00080000:0.0:1787096513.034963:0:5760:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787096513.035041:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787096513.035059:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9db282ffde00/0xdf123ee4d6335ae lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93bbba3c5a0d83a7 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096513.035126:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9db282ffc200/0xdf123ee4d6335b5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096513.035140:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9db282ffc200/0xdf123ee4d6335b5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096513.035152:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9db282ffc200/0xdf123ee4d6335b5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787096513.035204:0:5795:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1787096513.035207:0:5795:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1787096513.035231:0:5795:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9db282ffc200/0xdf123ee4d6335b5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096513.035254:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9db282ffde00/0xdf123ee4d6335ae lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.45@tcp remote: 0x93bbba3c5a0d83a7 expref: 10 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096513.035271:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9db282ffc200/0xdf123ee4d6335b5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.45@tcp remote: 0x93bbba3c5a0d83a7 expref: 9 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096513.035279:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9db284b25d00) 00010000:00010000:3.0:1787096513.035281:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787096513.035285:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9db282ffc200, rc 0) 00000100:00100000:3.0:1787096513.035340:0:5795:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9db2bfc9b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7354022b-ee92-4e63-a611-5f745ec24594+9:25593:x1873906345480192:12345-192.168.203.45@tcp:101:lfs.0 Request processed in 382us (541us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096513.035347:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 109 00000100:00100000:1.0:1787096513.036953:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787096513.037021:0:5763:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906345480320 00000100:00100000:3.0:1787096513.037028:0:5763:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906345480320 00000100:00100000:3.0:1787096513.037079:0:5763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 110 00000100:00100000:3.0:1787096513.037090:0:5763:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9db2bfc9a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7354022b-ee92-4e63-a611-5f745ec24594+9:25593:x1873906345480320:12345-192.168.203.45@tcp:101:lfs.0 00010000:00010000:3.0:1787096513.037105:0:5763:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787096513.037120:0:5763:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9db282ffc800/0xdf123ee4d6335bc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93bbba3c5a0d83ae expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096513.037182:0:5763:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9db282ffd800/0xdf123ee4d6335c3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096513.037194:0:5763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9db282ffd800/0xdf123ee4d6335c3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096513.037204:0:5763:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9db282ffd800/0xdf123ee4d6335c3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096513.037219:0:5763:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9db282ffcc00/0xdf123ee4d6335ca lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x64d10ce5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096513.037226:0:5763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9db282ffcc00/0xdf123ee4d6335ca lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x64d10ce5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096513.037233:0:5763:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9db282ffcc00/0xdf123ee4d6335ca lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x64d10ce5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096513.037286:0:5763:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9db282ffd800/0xdf123ee4d6335c3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096513.037299:0:5763:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9db282ffd800/0xdf123ee4d6335c3 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096513.037306:0:5763:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9db282ffd800/0xdf123ee4d6335c3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096513.037322:0:5763:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9db282ffd800 already unused, calling callback (ffffffffc205b4f0) 00010000:00010000:3.0:1787096513.037326:0:5763:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9db282ffd800/0xdf123ee4d6335c3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096513.037334:0:5763:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9db282ffd800/0xdf123ee4d6335c3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096513.037346:0:5763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9db284b25d00) 00010000:00010000:3.0:1787096513.037349:0:5763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787096513.037353:0:5763:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9db282ffd800/0xdf123ee4d6335c3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096513.037359:0:5763:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9db282ffd800/0xdf123ee4d6335c3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096513.037370:0:5763:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9db282ffcc00/0xdf123ee4d6335ca lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x64d10ce5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096513.037376:0:5763:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9db282ffcc00/0xdf123ee4d6335ca lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x64d10ce5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096513.037382:0:5763:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9db282ffcc00/0xdf123ee4d6335ca lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x64d10ce5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096513.037387:0:5763:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9db282ffcc00 already unused, calling callback (ffffffffc205b4f0) 00010000:00010000:3.0:1787096513.037390:0:5763:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9db282ffcc00/0xdf123ee4d6335ca lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x64d10ce5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096513.037395:0:5763:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9db282ffcc00/0xdf123ee4d6335ca lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x64d10ce5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096513.037413:0:5763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x64d10ce5 (ffff9db284b25a00) 00010000:00010000:3.0:1787096513.037416:0:5763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787096513.037418:0:5763:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9db282ffcc00/0xdf123ee4d6335ca lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x64d10ce5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096513.037424:0:5763:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9db282ffcc00/0xdf123ee4d6335ca lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x64d10ce5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096513.037455:0:5763:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9db282ffc800/0xdf123ee4d6335bc lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.45@tcp remote: 0x93bbba3c5a0d83ae expref: 10 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096513.037464:0:5763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9db284b25d00) 00010000:00010000:3.0:1787096513.037467:0:5763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787096513.037471:0:5763:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9db282ffc800/0xdf123ee4d6335bc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.45@tcp remote: 0x93bbba3c5a0d83ae expref: 10 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096513.037481:0:5763:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9db282ffc800, rc 0) 00000100:00100000:3.0:1787096513.037706:0:5763:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9db2bfc9a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7354022b-ee92-4e63-a611-5f745ec24594+9:25593:x1873906345480320:12345-192.168.203.45@tcp:101:lfs.0 Request processed in 618us (755us total) trans 0 rc 301/301 00000100:00100000:3.0:1787096513.037733:0:5763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 110 00000100:00100000:1.0:1787096513.040210:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787096513.040293:0:5764:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906345480576 00000100:00100000:0.0:1787096513.040300:0:5764:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906345480576 00000100:00100000:0.0:1787096513.040346:0:5764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 111 00000100:00100000:0.0:1787096513.040357:0:5764:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9db2bfc98700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7354022b-ee92-4e63-a611-5f745ec24594+9:25593:x1873906345480576:12345-192.168.203.45@tcp:101:lfs.0 00010000:00010000:0.0:1787096513.040373:0:5764:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787096513.040376:0:5764:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1787096513.040399:0:5764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9db282ffc200/0xdf123ee4d6335b5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.45@tcp remote: 0x93bbba3c5a0d83a7 expref: 9 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096513.040416:0:5764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9db284b25d00) 00010000:00010000:0.0:1787096513.040423:0:5764:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787096513.040439:0:5764:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9db2acda4000/0xdf123ee4d6335d1 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93bbba3c5a0d83b5 expref: -99 pid: 5764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096513.040592:0:5764:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9db2acda5600/0xdf123ee4d6335d8 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096513.040604:0:5764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9db2acda5600/0xdf123ee4d6335d8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096513.040613:0:5764:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9db2acda5600/0xdf123ee4d6335d8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096513.040624:0:5764:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9db2acda4800/0xdf123ee4d6335df lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x64d10ce5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096513.040630:0:5764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9db2acda4800/0xdf123ee4d6335df lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x64d10ce5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096513.040637:0:5764:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9db2acda4800/0xdf123ee4d6335df lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x64d10ce5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096513.041065:0:5764:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9db2acda5800/0xdf123ee4d6335e6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096513.041071:0:5764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9db2acda5800/0xdf123ee4d6335e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096513.041076:0:5764:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9db2acda5800/0xdf123ee4d6335e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5764 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787096513.041083:0:5764:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:0.0:1787096513.041101:0:5764:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9db2acda5600/0xdf123ee4d6335d8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096513.041112:0:5764:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9db2acda5600/0xdf123ee4d6335d8 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096513.041116:0:5764:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9db2acda5600/0xdf123ee4d6335d8 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096513.041120:0:5764:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9db2acda5600 already unused, calling callback (ffffffffc205b4f0) 00010000:00010000:0.0:1787096513.041123:0:5764:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9db2acda5600/0xdf123ee4d6335d8 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096513.041128:0:5764:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9db2acda5600/0xdf123ee4d6335d8 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096513.041133:0:5764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9db2bca3ac00) 00010000:00010000:0.0:1787096513.041135:0:5764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787096513.041137:0:5764:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9db2acda5600/0xdf123ee4d6335d8 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096513.041140:0:5764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9db2acda5600/0xdf123ee4d6335d8 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5764 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787096513.041147:0:5764:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 0000000046046a50 reply state 00000000e31083d0 transno 4294967342 ns: mdt-lustre-MDT0000_UUID lock: ffff9db2acda4800/0xdf123ee4d6335df lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x64d10ce5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5764 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787096513.041153:0:5764:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1787096513.041170:0:5764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9db2acda4000/0xdf123ee4d6335d1 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.45@tcp remote: 0x93bbba3c5a0d83b5 expref: 11 pid: 5764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096513.041181:0:5764:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9db2acda5800/0xdf123ee4d6335e6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.45@tcp remote: 0x93bbba3c5a0d83b5 expref: 10 pid: 5764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096513.041195:0:5764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9db2bca3a300) 00010000:00010000:0.0:1787096513.041198:0:5764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787096513.041201:0:5764:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9db2acda5800, rc 0) 00000100:00100000:0.0:1787096513.041259:0:5764:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9db2bfc98700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7354022b-ee92-4e63-a611-5f745ec24594+11:25593:x1873906345480576:12345-192.168.203.45@tcp:101:lfs.0 Request processed in 904us (1054us total) trans 4294967342 rc 0/0 00000100:00100000:0.0:1787096513.041265:0:5764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 111 00010000:00010000:3.0:1787096513.042353:0:3280:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9db2acda4800/0xdf123ee4d6335df lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x64d10ce5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096513.042365:0:3280:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9db2acda4800/0xdf123ee4d6335df lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x64d10ce5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096513.042372:0:3280:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9db2acda4800/0xdf123ee4d6335df lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x64d10ce5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096513.042388:0:3280:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9db2acda4800 already unused, calling callback (ffffffffc205b4f0) 00010000:00010000:3.0:1787096513.042393:0:3280:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9db2acda4800/0xdf123ee4d6335df lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x64d10ce5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096513.042400:0:3280:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9db2acda4800/0xdf123ee4d6335df lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x64d10ce5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096513.042413:0:3280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x64d10ce5 (ffff9db2bca3a700) 00010000:00010000:3.0:1787096513.042416:0:3280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787096513.042421:0:3280:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9db2acda4800/0xdf123ee4d6335df lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x64d10ce5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096513.042427:0:3280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9db2acda4800/0xdf123ee4d6335df lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x64d10ce5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5764 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787096513.043469:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787096513.043561:0:5795:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906345480832 00000100:00100000:3.0:1787096513.043569:0:5795:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906345480832 00000100:00100000:3.0:1787096513.043620:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 112 00000100:00100000:3.0:1787096513.043630:0:5795:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9db2bfc98380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7354022b-ee92-4e63-a611-5f745ec24594+10:25593:x1873906345480832:12345-192.168.203.45@tcp:101:lfs.0 00010000:00010000:3.0:1787096513.043649:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787096513.043670:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9db282ffde00/0xdf123ee4d6335f4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93bbba3c5a0d83bc expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096513.043758:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9db282ffc400/0xdf123ee4d6335fb lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096513.043771:0:5795:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9db2acda5800/0xdf123ee4d6335e6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.45@tcp remote: 0x93bbba3c5a0d83b5 expref: 11 pid: 5764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096513.043790:0:5795:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9db282ffc400/0xdf123ee4d6335fb lrc: 4/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096513.043821:0:5795:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9db2acda5800/0xdf123ee4d6335e6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.45@tcp remote: 0x93bbba3c5a0d83b5 expref: 11 pid: 5764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096513.043833:0:5795:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9db2acda5800/0xdf123ee4d6335e6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.45@tcp remote: 0x93bbba3c5a0d83b5 expref: 11 pid: 5764 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787096513.043845:0:5795:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9db2b44ec000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:5795:1873906353887104:192.168.203.45@tcp:104: 00000100:00100000:3.0:1787096513.043926:0:5795:0:(client.c:2692:ptlrpc_set_wait()) set ffff9db28371fa80 going to sleep for 11 seconds 00000100:00100000:1.0:1787096513.049174:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787096513.049224:0:7415:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906345480960 00000100:00100000:0.0:1787096513.049233:0:7415:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906345480960 00000100:00100000:3.0:1787096513.049245:0:5795:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9db2b44ec000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:5795:1873906353887104:192.168.203.45@tcp:104: 00010000:00010000:3.0:1787096513.049268:0:5795:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9db282ffc400/0xdf123ee4d6335fb lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096513.049268:0:7415:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9db2acda5800/0xdf123ee4d6335e6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.45@tcp remote: 0x93bbba3c5a0d83b5 expref: 12 pid: 5764 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787096513.049318:0:7415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 39 00000100:00100000:0.0:1787096513.049328:0:7415:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9db2848f7850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7354022b-ee92-4e63-a611-5f745ec24594+12:2358:x1873906345480960:12345-192.168.203.45@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787096513.049342:0:7415:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787096513.049348:0:7415:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9db2acda5800/0xdf123ee4d6335e6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.45@tcp remote: 0x93bbba3c5a0d83b5 expref: 12 pid: 5764 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096513.049360:0:7415:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9db2acda5800/0xdf123ee4d6335e6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.45@tcp remote: 0x93bbba3c5a0d83b5 expref: 12 pid: 5764 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096513.049380:0:7415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9db2acda5800/0xdf123ee4d6335e6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.45@tcp remote: 0x93bbba3c5a0d83b5 expref: 12 pid: 5764 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096513.049393:0:7415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9db2bca3a300) 00010000:00010000:0.0:1787096513.049397:0:7415:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9db282ffc400/0xdf123ee4d6335fb lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096513.049413:0:7415:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9db282ffc400/0xdf123ee4d6335fb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096513.049420:0:7415:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9db282ffc400/0xdf123ee4d6335fb lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096513.049444:0:7415:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787096513.049465:0:5795:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9db282ffc400/0xdf123ee4d6335fb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096513.049473:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9db282ffc400/0xdf123ee4d6335fb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787096513.049492:0:5795:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000100:00100000:0.0:1787096513.049494:0:7415:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9db2848f7850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7354022b-ee92-4e63-a611-5f745ec24594+11:2358:x1873906345480960:12345-192.168.203.45@tcp:103:ldlm_bl.0 Request processed in 167us (327us total) trans 0 rc 0/0 00000100:00100000:0.0:1787096513.049530:0:7415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 39 00010000:00010000:3.0:1787096513.049828:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9db282ffc400/0xdf123ee4d6335fb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096513.049838:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9db282ffc400/0xdf123ee4d6335fb lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096513.049937:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9db282ffc400/0xdf123ee4d6335fb lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096513.049945:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9db282ffc400 already unused, calling callback (ffffffffc205b4f0) 00010000:00010000:3.0:1787096513.049950:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9db282ffc400/0xdf123ee4d6335fb lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096513.049959:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9db282ffc400/0xdf123ee4d6335fb lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096513.049970:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9db2bca3a300) 00010000:00010000:3.0:1787096513.049972:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787096513.049976:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9db282ffc400/0xdf123ee4d6335fb lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096513.049981:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9db282ffc400/0xdf123ee4d6335fb lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096513.050021:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9db282ffde00/0xdf123ee4d6335f4 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.45@tcp remote: 0x93bbba3c5a0d83bc expref: 10 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096513.050031:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9db284b25200) 00010000:00010000:3.0:1787096513.050034:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787096513.050038:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9db282ffde00/0xdf123ee4d6335f4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.45@tcp remote: 0x93bbba3c5a0d83bc expref: 10 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096513.050050:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9db282ffde00, rc 0) 00000100:00100000:3.0:1787096513.050088:0:5795:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9db2bfc98380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7354022b-ee92-4e63-a611-5f745ec24594+9:25593:x1873906345480832:12345-192.168.203.45@tcp:101:lfs.0 Request processed in 6460us (6622us total) trans 0 rc 301/301 00000100:00100000:3.0:1787096513.050105:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 112 00000100:00100000:1.0:1787096513.052066:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787096513.052110:0:5767:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906345481216 00000100:00100000:3.0:1787096513.052117:0:5767:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906345481216 00000100:00100000:3.0:1787096513.052165:0:5767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 17 00000100:00100000:3.0:1787096513.052176:0:5767:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9db2bfc99500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7354022b-ee92-4e63-a611-5f745ec24594+9:25593:x1873906345481216:12345-192.168.203.45@tcp:35:lfs.0 00000100:00100000:3.0:1787096513.052360:0:5767:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9db2bfc99500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7354022b-ee92-4e63-a611-5f745ec24594+10:25593:x1873906345481216:12345-192.168.203.45@tcp:35:lfs.0 Request processed in 187us (298us total) trans 4294967343 rc 0/0 00000100:00100000:3.0:1787096513.052366:0:5767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 17 00010000:00010000:1.0:1787096513.074623:0:5753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787096513.076329:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787096513.076373:0:5757:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906345481344 00000100:00100000:1.0:1787096513.076382:0:5757:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906345481344 00000100:00100000:1.0:1787096513.076430:0:5757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 234 00000100:00100000:1.0:1787096513.076440:0:5757:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9db2a0663c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec888d3e-dbb7-4169-a63e-f9e2c57de4f6+9:2355:x1873906345481344:12345-192.168.203.45@tcp:400:kworker.0 00000100:00100000:1.0:1787096513.076533:0:5757:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9db2a0663c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec888d3e-dbb7-4169-a63e-f9e2c57de4f6+9:2355:x1873906345481344:12345-192.168.203.45@tcp:400:kworker.0 Request processed in 93us (207us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096513.076542:0:5757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 234 00000001:00080000:2.0:1787096513.338451:0:5785:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967342 is committed 00000001:00080000:2.0:1787096513.338479:0:5785:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967343 is committed 00000001:02000400:1.0:1787096513.558358:0:20880:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-ec test_6b: @@@@@@ FAIL: create EC file failed 00010000:00010000:3.0:1787096514.097682:0:6553:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 397 lines, 397 kept, 0 dropped, 0 bad.