00010000:00010000:0.0F:1777502229.969734:0:188362:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0F:1777502230.994700:0:186924:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0F:1777502231.289539:0:208989:0:(nrs_tbf.c:531:nrs_tbf_cli_fini()) mdt.0 NRS: TBF class fini: class@ffff8dfd4661bf00 key gid={0} rule@0xffff8dfd489ef800 gen 0 rate 10000 depth 3 token 0 deadline 8355808194497 time 8355808146519 state 0x6 ref 0 00010000:00010000:3.0:1777502232.018684:0:186925:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1777502232.223692:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1777502232.223748:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1777502232.223771:0:186931:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837563149568 00000100:00100000:3.0:1777502232.223782:0:186931:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837563149568 00000100:00100000:2.0:1777502232.223800:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1777502232.223835:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1777502232.223841:0:186931:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 267 00000100:00100000:3.0:1777502232.223854:0:186931:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfd7ee1d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c3865704-aa9b-444e-8420-b5af90b3c217+12:2370:x1863837563149568:12345-192.168.202.27@tcp:400:kworker.0 00000100:00100000:2.0:1777502232.223875:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1777502232.223904:0:205379:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837563149952 00000100:00100000:2.0:1777502232.223908:0:205379:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837563149952 00000100:00100000:3.0:1777502232.223925:0:186931:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfd7ee1d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c3865704-aa9b-444e-8420-b5af90b3c217+12:2370:x1863837563149568:12345-192.168.202.27@tcp:400:kworker.0 Request processed in 73us (240us total) trans 0 rc 0/0 00000100:00100000:3.0:1777502232.223934:0:186931:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 267 00000100:00100000:2.0:1777502232.223951:0:205379:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837563150080 00000100:00100000:2.0:1777502232.223954:0:205379:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837563150080 00000100:00100000:2.0:1777502232.223984:0:205379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 249 00000100:00100000:2.0:1777502232.223991:0:205379:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfc511dad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:0775d2ab-558e-41f1-82c0-14244d133390+11:2371:x1863837563149952:12345-192.168.202.27@tcp:400:kworker.0 00000100:00100000:2.0:1777502232.224020:0:205379:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfc511dad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:0775d2ab-558e-41f1-82c0-14244d133390+11:2371:x1863837563149952:12345-192.168.202.27@tcp:400:kworker.0 Request processed in 30us (222us total) trans 0 rc 0/0 00000100:00100000:2.0:1777502232.224025:0:205379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 249 00000100:00100000:2.0:1777502232.224042:0:205379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 250 00000100:00100000:2.0:1777502232.224048:0:205379:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfc511d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:0775d2ab-558e-41f1-82c0-14244d133390+11:2370:x1863837563150080:12345-192.168.202.27@tcp:400:kworker.0 00000100:00100000:2.0:1777502232.224068:0:205379:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfc511d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:0775d2ab-558e-41f1-82c0-14244d133390+11:2370:x1863837563150080:12345-192.168.202.27@tcp:400:kworker.0 Request processed in 20us (195us total) trans 0 rc 0/0 00000100:00100000:2.0:1777502232.224074:0:205379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 250 00000100:00100000:0.0:1777502232.224201:0:188648:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837563149696 00000100:00100000:0.0:1777502232.224206:0:188648:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837563149696 00000100:00100000:0.0:1777502232.224250:0:188648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 212 00000100:00100000:0.0:1777502232.224259:0:188648:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfc511dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4254d622-1c5a-45a0-aa2f-9afde5f83f6d+12:2371:x1863837563149696:12345-192.168.202.27@tcp:400:kworker.0 00000100:00100000:2.0:1777502232.224282:0:186937:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837563149824 00000100:00100000:2.0:1777502232.224288:0:186937:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837563149824 00000100:00100000:0.0:1777502232.224310:0:188648:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfc511dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4254d622-1c5a-45a0-aa2f-9afde5f83f6d+12:2371:x1863837563149696:12345-192.168.202.27@tcp:400:kworker.0 Request processed in 52us (562us total) trans 0 rc 0/0 00000100:00100000:0.0:1777502232.224318:0:188648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 212 00000100:00100000:0.0:1777502232.224341:0:188648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 213 00000100:00100000:0.0:1777502232.224350:0:188648:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfc511d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0775d2ab-558e-41f1-82c0-14244d133390+62:2370:x1863837563149824:12345-192.168.202.27@tcp:400:kworker.0 00000100:00100000:0.0:1777502232.224380:0:188648:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfc511d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0775d2ab-558e-41f1-82c0-14244d133390+62:2370:x1863837563149824:12345-192.168.202.27@tcp:400:kworker.0 Request processed in 32us (545us total) trans 0 rc 0/0 00000100:00080000:2.0:1777502232.224433:0:186932:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1777502232.224440:0:186932:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1777502232.224443:0:186932:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1777502232.224839:0:188648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 213 00010000:00010000:0.0:1777502233.041753:0:205387:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1777502233.323227:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1777502233.323301:0:187571:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837563150208 00000100:00100000:0.0:1777502233.323310:0:187571:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837563150208 00000100:00100000:0.0:1777502233.323359:0:187571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3816 00000100:00100000:0.0:1777502233.323369:0:187571:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfc511d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4254d622-1c5a-45a0-aa2f-9afde5f83f6d+12:274351:x1863837563150208:12345-192.168.202.27@tcp:101:rm.0 00010000:00010000:0.0:1777502233.323385:0:187571:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777502233.323404:0:187571:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6da00/0x4ad31463d9bc4811 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac3ccf43bf83471a expref: -99 pid: 187571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.323485:0:187571:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6d000/0x4ad31463d9bc4818 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.323507:0:187571:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6d000/0x4ad31463d9bc4818 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.323520:0:187571:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6d000/0x4ad31463d9bc4818 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187571 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1777502233.323780:0:187571:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd1:0x20:0x0]: returning size 7680 00000004:00200000:0.0:1777502233.323784:0:187571:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 12 stripe count 1 MDT count 1 00000004:00010000:0.0:1777502233.323870:0:187571:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6d000/0x4ad31463d9bc4818 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.323893:0:187571:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6da00/0x4ad31463d9bc4811 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xac3ccf43bf83471a expref: 14 pid: 187571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.323907:0:187571:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6d000/0x4ad31463d9bc4818 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xac3ccf43bf83471a expref: 13 pid: 187571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.323913:0:187571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffff8dfd7f712b00) 00010000:00010000:0.0:1777502233.323916:0:187571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1777502233.323918:0:187571:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dfd77e6d000, rc 0) 00000100:00100000:0.0:1777502233.323966:0:187571:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfc511d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4254d622-1c5a-45a0-aa2f-9afde5f83f6d+13:274351:x1863837563150208:12345-192.168.202.27@tcp:101:rm.0 Request processed in 599us (749us total) trans 0 rc 0/0 00000100:00100000:0.0:1777502233.323971:0:187571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3816 00000100:00100000:3.0:1777502233.325395:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1777502233.325448:0:186937:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837563150464 00000100:00100000:2.0:1777502233.325456:0:186937:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837563150464 00000100:00100000:2.0:1777502233.325515:0:186937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3817 00000100:00100000:2.0:1777502233.325534:0:186937:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfd7f79ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4254d622-1c5a-45a0-aa2f-9afde5f83f6d+13:274351:x1863837563150464:12345-192.168.202.27@tcp:101:rm.0 00010000:00010000:2.0:1777502233.325549:0:186937:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777502233.325562:0:186937:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd7eec9a00/0x4ad31463d9bc481f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac3ccf43bf834721 expref: -99 pid: 186937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1777502233.326947:0:186937:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd1:0x20:0x0]: returning size 7680 00010000:00010000:2.0:1777502233.327314:0:186937:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd7eec9a00/0x4ad31463d9bc481f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xac3ccf43bf834721 expref: 15 pid: 186937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777502233.327332:0:186937:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dfd7f712100) 00010000:00010000:2.0:1777502233.327336:0:186937:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1777502233.327342:0:186937:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd7eec9a00/0x4ad31463d9bc481f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.27@tcp remote: 0xac3ccf43bf834721 expref: 15 pid: 186937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777502233.327358:0:186937:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dfd7eec9a00, rc 0) 00000100:00100000:2.0:1777502233.327431:0:186937:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfd7f79ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4254d622-1c5a-45a0-aa2f-9afde5f83f6d+14:274351:x1863837563150464:12345-192.168.202.27@tcp:101:rm.0 Request processed in 1900us (2038us total) trans 8589939066 rc 301/301 00000100:00100000:2.0:1777502233.327442:0:186937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3817 00000100:00100000:3.0:1777502233.329358:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1777502233.329402:0:189686:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837563150592 00000100:00100000:2.0:1777502233.329413:0:189686:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837563150592 00000100:00100000:2.0:1777502233.329461:0:189686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1170 00000100:00100000:2.0:1777502233.329473:0:189686:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfd7f79c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4254d622-1c5a-45a0-aa2f-9afde5f83f6d+14:274351:x1863837563150592:12345-192.168.202.27@tcp:37:rm.0 00000100:00100000:2.0:1777502233.331975:0:189686:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfd7f79c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4254d622-1c5a-45a0-aa2f-9afde5f83f6d+14:274351:x1863837563150592:12345-192.168.202.27@tcp:37:rm.0 Request processed in 2497us (2614us total) trans 0 rc 0/0 00000100:00100000:2.0:1777502233.331987:0:189686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1170 00000100:00100000:3.0:1777502233.334251:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1777502233.334307:0:186940:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837563150848 00000100:00100000:2.0:1777502233.334325:0:186940:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837563150848 00000100:00100000:2.0:1777502233.334363:0:186940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1171 00000100:00100000:2.0:1777502233.334372:0:186940:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfd7f79d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4254d622-1c5a-45a0-aa2f-9afde5f83f6d+14:274351:x1863837563150848:12345-192.168.202.27@tcp:35:rm.0 00000100:00100000:2.0:1777502233.334959:0:186940:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfd7f79d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4254d622-1c5a-45a0-aa2f-9afde5f83f6d+15:274351:x1863837563150848:12345-192.168.202.27@tcp:35:rm.0 Request processed in 586us (711us total) trans 8589939067 rc 0/0 00000100:00100000:2.0:1777502233.334969:0:186940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1171 00000100:00100000:3.0:1777502233.336110:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1777502233.336164:0:205372:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837563151104 00000100:00100000:2.0:1777502233.336171:0:205372:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837563151104 00000100:00100000:2.0:1777502233.336224:0:205372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3818 00000100:00100000:2.0:1777502233.336235:0:205372:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfc5843ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:4254d622-1c5a-45a0-aa2f-9afde5f83f6d+15:274351:x1863837563151104:12345-192.168.202.27@tcp:101:rm.0 00010000:00010000:2.0:1777502233.336253:0:205372:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777502233.336271:0:205372:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd7eec9a00/0x4ad31463d9bc482d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac3ccf43bf834728 expref: -99 pid: 205372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777502233.336471:0:205372:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd7eec8800/0x4ad31463d9bc4834 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 205372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777502233.336484:0:205372:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd7eec8800/0x4ad31463d9bc4834 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 205372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777502233.336507:0:205372:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd7eec8800/0x4ad31463d9bc4834 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 205372 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1777502233.336517:0:205372:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd1:0x20:0x0]: returning size 7680 00010000:00010000:2.0:1777502233.336727:0:205372:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd7eec9a00/0x4ad31463d9bc482d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xac3ccf43bf834728 expref: 18 pid: 205372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777502233.336745:0:205372:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd7eec8800/0x4ad31463d9bc4834 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xac3ccf43bf834728 expref: 17 pid: 205372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777502233.336766:0:205372:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffff8dfd7f712b00) 00010000:00010000:2.0:1777502233.336770:0:205372:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1777502233.336774:0:205372:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dfd7eec8800, rc 0) 00000100:00100000:2.0:1777502233.336819:0:205372:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfc5843ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:4254d622-1c5a-45a0-aa2f-9afde5f83f6d+17:274351:x1863837563151104:12345-192.168.202.27@tcp:101:rm.0 Request processed in 585us (711us total) trans 8589939068 rc 0/0 00000100:00100000:2.0:1777502233.336827:0:205372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3818 00000100:00100000:3.0:1777502233.337910:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1777502233.337945:0:205369:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837563151232 00000100:00100000:2.0:1777502233.337952:0:205369:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837563151232 00000100:00100000:2.0:1777502233.337996:0:205369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3819 00000100:00100000:2.0:1777502233.338008:0:205369:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfc5843e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:4254d622-1c5a-45a0-aa2f-9afde5f83f6d+17:274351:x1863837563151232:12345-192.168.202.27@tcp:41:rm.0 00000004:00000024:2.0:1777502233.338047:0:205369:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 7666139136 avail 7661944832 00000100:00100000:2.0:1777502233.338088:0:205369:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfc5843e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:4254d622-1c5a-45a0-aa2f-9afde5f83f6d+17:274351:x1863837563151232:12345-192.168.202.27@tcp:41:rm.0 Request processed in 83us (182us total) trans 0 rc 0/0 00000100:00100000:2.0:1777502233.338096:0:205369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3819 00000100:00100000:3.0:1777502233.338930:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1777502233.338979:0:186936:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837563151360 00000100:00100000:0.0:1777502233.338985:0:186936:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837563151360 00000100:00100000:0.0:1777502233.339024:0:186936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3820 00000100:00100000:0.0:1777502233.339032:0:186936:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfd7c2fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4254d622-1c5a-45a0-aa2f-9afde5f83f6d+17:274351:x1863837563151360:12345-192.168.202.27@tcp:101:rm.0 00010000:00010000:0.0:1777502233.339042:0:186936:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777502233.339058:0:186936:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6da00/0x4ad31463d9bc4842 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac3ccf43bf83472f expref: -99 pid: 186936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.339107:0:186936:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6c000/0x4ad31463d9bc4849 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 186936 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.339132:0:186936:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6c000/0x4ad31463d9bc4849 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 186936 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.339143:0:186936:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6c000/0x4ad31463d9bc4849 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 186936 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.339160:0:186936:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6de00/0x4ad31463d9bc4850 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 186936 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.339168:0:186936:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6de00/0x4ad31463d9bc4850 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 186936 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.339176:0:186936:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6de00/0x4ad31463d9bc4850 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 186936 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.339646:0:186936:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6cc00/0x4ad31463d9bc4857 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x214:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 186936 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.339657:0:186936:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6cc00/0x4ad31463d9bc4857 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x214:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 186936 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.339666:0:186936:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6cc00/0x4ad31463d9bc4857 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x214:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 186936 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1777502233.339693:0:186936:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd2:0x214:0x0]: returning size 0 00000004:00200000:0.0:1777502233.339697:0:186936:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1777502233.339711:0:186936:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6cc00/0x4ad31463d9bc4857 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x214:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 186936 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.339723:0:186936:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6cc00/0x4ad31463d9bc4857 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x214:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 186936 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.339741:0:186936:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6c000/0x4ad31463d9bc4849 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 186936 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.339748:0:186936:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6c000/0x4ad31463d9bc4849 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 186936 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.339755:0:186936:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6c000/0x4ad31463d9bc4849 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 186936 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.339762:0:186936:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfd77e6c000 already unused, calling callback (ffffffffc1e434f0) 00010000:00010000:0.0:1777502233.339767:0:186936:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6c000/0x4ad31463d9bc4849 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 186936 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.339775:0:186936:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6c000/0x4ad31463d9bc4849 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 186936 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.339786:0:186936:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffff8dfd7f712b00) 00010000:00010000:0.0:1777502233.339789:0:186936:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777502233.339794:0:186936:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6c000/0x4ad31463d9bc4849 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 186936 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.339800:0:186936:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6c000/0x4ad31463d9bc4849 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 186936 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.339811:0:186936:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6de00/0x4ad31463d9bc4850 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 186936 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.339818:0:186936:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6de00/0x4ad31463d9bc4850 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 186936 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.339824:0:186936:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6de00/0x4ad31463d9bc4850 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 186936 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.339834:0:186936:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfd77e6de00 already unused, calling callback (ffffffffc1e434f0) 00010000:00010000:0.0:1777502233.339838:0:186936:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6de00/0x4ad31463d9bc4850 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 186936 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.339845:0:186936:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6de00/0x4ad31463d9bc4850 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 186936 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.339855:0:186936:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0xc91ac0a8 (ffff8dfd7fc41b00) 00010000:00010000:0.0:1777502233.339858:0:186936:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777502233.339862:0:186936:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6de00/0x4ad31463d9bc4850 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 186936 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.339868:0:186936:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6de00/0x4ad31463d9bc4850 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 186936 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.339902:0:186936:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6da00/0x4ad31463d9bc4842 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xac3ccf43bf83472f expref: 19 pid: 186936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.339917:0:186936:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6cc00/0x4ad31463d9bc4857 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x214:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xac3ccf43bf83472f expref: 18 pid: 186936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.339924:0:186936:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x214:0x0].0x0 (ffff8dfd67320c00) 00010000:00010000:0.0:1777502233.339928:0:186936:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1777502233.339931:0:186936:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dfd77e6cc00, rc 0) 00000100:00100000:0.0:1777502233.339971:0:186936:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfd7c2fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4254d622-1c5a-45a0-aa2f-9afde5f83f6d+18:274351:x1863837563151360:12345-192.168.202.27@tcp:101:rm.0 Request processed in 939us (1044us total) trans 0 rc 0/0 00000100:00100000:0.0:1777502233.339980:0:186936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3820 00000100:00100000:3.0:1777502233.341779:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1777502233.341831:0:188648:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837563151616 00000100:00100000:0.0:1777502233.341846:0:188648:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837563151616 00000100:00100000:0.0:1777502233.341895:0:188648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3821 00000100:00100000:0.0:1777502233.341906:0:188648:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfd7c2fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4254d622-1c5a-45a0-aa2f-9afde5f83f6d+18:274351:x1863837563151616:12345-192.168.202.27@tcp:36:rm.0 00010000:00010000:0.0:1777502233.341960:0:188648:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1777502233.341982:0:188648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6cc00/0x4ad31463d9bc4857 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x214:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xac3ccf43bf83472f expref: 18 pid: 186936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.341999:0:188648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x214:0x0].0x0 (ffff8dfd67320c00) 00010000:00010000:0.0:1777502233.342011:0:188648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6d000/0x4ad31463d9bc4818 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xac3ccf43bf83471a expref: 17 pid: 187571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.342022:0:188648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffff8dfd7f712b00) 00010000:00010000:0.0:1777502233.342026:0:188648:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1777502233.342044:0:188648:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6ce00/0x4ad31463d9bc485e lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 188648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.342055:0:188648:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6ce00/0x4ad31463d9bc485e lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 188648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.342065:0:188648:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6ce00/0x4ad31463d9bc485e lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 188648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.342085:0:188648:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6d200/0x4ad31463d9bc4865 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.342093:0:188648:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6d200/0x4ad31463d9bc4865 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.342101:0:188648:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6d200/0x4ad31463d9bc4865 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.342541:0:188648:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6c200/0x4ad31463d9bc486c lrc: 3/0,1 mode: --/EX res: [0x200000bd2:0x214:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 188648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.342555:0:188648:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd7f5e3200/0x4ad31463d9bc4214 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x214:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xac3ccf43bf834617 expref: 61 pid: 186942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.342565:0:188648:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4fbbdc00/0x4ad31463d9bc4310 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x214:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xac3ccf43bf834656 expref: 61 pid: 186942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.342573:0:188648:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6c200/0x4ad31463d9bc486c lrc: 5/0,1 mode: --/EX res: [0x200000bd2:0x214:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 188648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.342635:0:188648:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4fbbdc00/0x4ad31463d9bc4310 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x214:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xac3ccf43bf834656 expref: 61 pid: 186942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.342651:0:188648:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4fbbdc00/0x4ad31463d9bc4310 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x214:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xac3ccf43bf834656 expref: 61 pid: 186942 timeout: 8460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777502233.342666:0:188648:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8dfc4ddb6680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:188648:1863837561410048:192.168.202.27@tcp:104: 00010000:00010000:0.0:1777502233.342760:0:188648:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd7f5e3200/0x4ad31463d9bc4214 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x214:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xac3ccf43bf834617 expref: 61 pid: 186942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.342772:0:188648:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd7f5e3200/0x4ad31463d9bc4214 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x214:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xac3ccf43bf834617 expref: 61 pid: 186942 timeout: 8460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777502233.342783:0:188648:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8dfc4ddb7480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:188648:1863837561410176:192.168.202.27@tcp:104: 00000100:00100000:0.0:1777502233.342823:0:188648:0:(client.c:2691:ptlrpc_set_wait()) set ffff8dfc49092d80 going to sleep for 11 seconds 00000100:00100000:0.0:1777502233.343760:0:188648:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8dfc4ddb6680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:188648:1863837561410048:192.168.202.27@tcp:104: 00000100:00100000:0.0:1777502233.343777:0:188648:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8dfc4ddb7480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:188648:1863837561410176:192.168.202.27@tcp:104: 00010000:00010000:0.0:1777502233.343799:0:188648:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6c200/0x4ad31463d9bc486c lrc: 3/0,1 mode: --/EX res: [0x200000bd2:0x214:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 188648 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777502233.344063:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1777502233.344113:0:186923:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837563151744 00000100:00100000:0.0:1777502233.344120:0:186923:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837563151744 00000100:00100000:3.0:1777502233.344127:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:0.0:1777502233.344158:0:186923:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd7f5e3200/0x4ad31463d9bc4214 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x214:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xac3ccf43bf834617 expref: 62 pid: 186942 timeout: 8460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777502233.344173:0:205589:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837563151872 00000100:00100000:2.0:1777502233.344180:0:205589:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837563151872 00000100:00100000:0.0:1777502233.344199:0:186923:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1142 00010000:00010000:2.0:1777502233.344204:0:205589:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4fbbdc00/0x4ad31463d9bc4310 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x214:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xac3ccf43bf834656 expref: 63 pid: 186942 timeout: 8460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777502233.344215:0:186923:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfd7c2ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0775d2ab-558e-41f1-82c0-14244d133390+63:2371:x1863837563151744:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1777502233.344226:0:186923:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1777502233.344233:0:186923:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd7f5e3200/0x4ad31463d9bc4214 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x214:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xac3ccf43bf834617 expref: 63 pid: 186942 timeout: 8460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.344244:0:186923:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd7f5e3200/0x4ad31463d9bc4214 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x214:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xac3ccf43bf834617 expref: 63 pid: 186942 timeout: 8460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777502233.344248:0:186921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1143 00000100:00100000:3.0:1777502233.344264:0:186921:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfd7c2fd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0775d2ab-558e-41f1-82c0-14244d133390+63:2370:x1863837563151872:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1777502233.344271:0:186923:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd7f5e3200/0x4ad31463d9bc4214 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x214:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xac3ccf43bf834617 expref: 63 pid: 186942 timeout: 8460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.344274:0:186921:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1777502233.344285:0:186921:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4fbbdc00/0x4ad31463d9bc4310 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x214:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xac3ccf43bf834656 expref: 62 pid: 186942 timeout: 8460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.344289:0:186923:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x214:0x0].0x0 (ffff8dfd67320c00) 00010000:00010000:0.0:1777502233.344297:0:186923:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6c200/0x4ad31463d9bc486c lrc: 3/0,1 mode: --/EX res: [0x200000bd2:0x214:0x0].0x0 bits 0x3/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 188648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.344317:0:186923:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6c200/0x4ad31463d9bc486c lrc: 3/0,1 mode: --/EX res: [0x200000bd2:0x214:0x0].0x0 bits 0x3/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 188648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.344323:0:186923:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1777502233.344331:0:186921:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4fbbdc00/0x4ad31463d9bc4310 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x214:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xac3ccf43bf834656 expref: 62 pid: 186942 timeout: 8460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.344361:0:186921:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4fbbdc00/0x4ad31463d9bc4310 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x214:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xac3ccf43bf834656 expref: 62 pid: 186942 timeout: 8460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777502233.344372:0:186923:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfd7c2ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0775d2ab-558e-41f1-82c0-14244d133390+61:2371:x1863837563151744:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 160us (307us total) trans 0 rc 0/0 00010000:00010000:3.0:1777502233.344376:0:186921:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x214:0x0].0x0 (ffff8dfd67320c00) 00010000:00010000:3.0:1777502233.344382:0:186921:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6c200/0x4ad31463d9bc486c lrc: 3/0,1 mode: --/EX res: [0x200000bd2:0x214:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 188648 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777502233.344382:0:186923:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1142 00010000:00010000:3.0:1777502233.344393:0:186921:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6c200/0x4ad31463d9bc486c lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x214:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 188648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.344400:0:186921:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6c200/0x4ad31463d9bc486c lrc: 4/0,1 mode: EX/EX res: [0x200000bd2:0x214:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 188648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.344425:0:186921:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1777502233.344441:0:188648:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6c200/0x4ad31463d9bc486c lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x214:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.344449:0:188648:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6c200/0x4ad31463d9bc486c lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x214:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188648 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777502233.344459:0:186921:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfd7c2fd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0775d2ab-558e-41f1-82c0-14244d133390+60:2370:x1863837563151872:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 200us (333us total) trans 0 rc 0/0 00000100:00100000:3.0:1777502233.344466:0:186921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1143 00000040:00080000:0.0:1777502233.345828:0:188648:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].539, 64 off42688 00000004:00080000:0.0:1777502233.345841:0:188648:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 8360591261471ns, next at 8361591259248ns, rc = 0 00010000:00010000:0.0:1777502233.345936:0:188648:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6dc00/0x4ad31463d9bc4873 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x214:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 188648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.345949:0:188648:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6dc00/0x4ad31463d9bc4873 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x214:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 188648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.345958:0:188648:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6dc00/0x4ad31463d9bc4873 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x214:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 188648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.345966:0:188648:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6dc00/0x4ad31463d9bc4873 lrc: 4/0,1 mode: PW/PW res: [0x200000bd2:0x214:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 188648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.345973:0:188648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6dc00/0x4ad31463d9bc4873 lrc: 4/0,1 mode: PW/PW res: [0x200000bd2:0x214:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 188648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.345991:0:188648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6dc00/0x4ad31463d9bc4873 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x214:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 188648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.346013:0:188648:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1777502233.346032:0:188648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6c200/0x4ad31463d9bc486c lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x214:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.346037:0:188648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6c200/0x4ad31463d9bc486c lrc: 2/0,0 mode: EX/EX res: [0x200000bd2:0x214:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 188648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.346041:0:188362:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1777502233.346045:0:188648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6c200/0x4ad31463d9bc486c lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0x214:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 188648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.346048:0:188362:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6dc00/0x4ad31463d9bc4873 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x214:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x40010480000000 pid: 188648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.346055:0:188648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfd77e6c200 already unused, calling callback (ffffffffc1e434f0) 00010000:00010000:3.0:1777502233.346060:0:188362:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfd77e6dc00 already unused, calling callback (ffffffffc13f52e0) 00010000:00010000:0.0:1777502233.346062:0:188648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6c200/0x4ad31463d9bc486c lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0x214:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 188648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.346067:0:188362:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6dc00/0x4ad31463d9bc4873 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x214:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x40010480000000 pid: 188648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.346074:0:188648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6c200/0x4ad31463d9bc486c lrc: 4/0,0 mode: EX/EX res: [0x200000bd2:0x214:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 188648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.346079:0:188362:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6dc00/0x4ad31463d9bc4873 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x214:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x40018480000000 pid: 188648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.346089:0:188648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x214:0x0].0x0 (ffff8dfd67320c00) 00010000:00010000:0.0:1777502233.346094:0:188648:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1777502233.346098:0:188648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6c200/0x4ad31463d9bc486c lrc: 2/0,0 mode: --/EX res: [0x200000bd2:0x214:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 188648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.346102:0:188362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x214:0x0].0x0 (ffff8dfd67320c00) 00010000:00010000:0.0:1777502233.346105:0:188648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6c200/0x4ad31463d9bc486c lrc: 0/0,0 mode: --/EX res: [0x200000bd2:0x214:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 188648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.346113:0:188362:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1777502233.346118:0:188362:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6dc00/0x4ad31463d9bc4873 lrc: 1/0,0 mode: --/PW res: [0x200000bd2:0x214:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 188648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.346121:0:188648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6ce00/0x4ad31463d9bc485e lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 188648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.346126:0:188362:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6dc00/0x4ad31463d9bc4873 lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0x214:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 188648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.346139:0:188648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6ce00/0x4ad31463d9bc485e lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 188648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.346143:0:188648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6ce00/0x4ad31463d9bc485e lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 188648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.346146:0:188362:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777502233.346147:0:188648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfd77e6ce00 already unused, calling callback (ffffffffc1e434f0) 00010000:00010000:3.0:1777502233.346150:0:188362:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777502233.346151:0:188648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6ce00/0x4ad31463d9bc485e lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 188648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.346157:0:188648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6ce00/0x4ad31463d9bc485e lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 188648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.346158:0:188362:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777502233.346166:0:188648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffff8dfd7f712b00) 00010000:00010000:0.0:1777502233.346169:0:188648:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777502233.346171:0:188648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6ce00/0x4ad31463d9bc485e lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 188648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.346175:0:188648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6ce00/0x4ad31463d9bc485e lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 188648 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1777502233.346185:0:188648:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000001724834f reply state 000000005be0a288 transno 8589939069 ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6d200/0x4ad31463d9bc4865 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188648 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777502233.346191:0:188648:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1777502233.346252:0:188648:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfd7c2fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4254d622-1c5a-45a0-aa2f-9afde5f83f6d+18:274351:x1863837563151616:12345-192.168.202.27@tcp:36:rm.0 Request processed in 4347us (4479us total) trans 8589939069 rc 0/0 00000100:00100000:0.0:1777502233.346261:0:188648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3821 00010000:00010000:3.0:1777502233.346892:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6d200/0x4ad31463d9bc4865 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.346903:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6d200/0x4ad31463d9bc4865 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.346910:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6d200/0x4ad31463d9bc4865 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.346917:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfd77e6d200 already unused, calling callback (ffffffffc1e434f0) 00010000:00010000:3.0:1777502233.346922:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6d200/0x4ad31463d9bc4865 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.346930:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6d200/0x4ad31463d9bc4865 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.346942:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0xc91ac0a8 (ffff8dfd7fc41000) 00010000:00010000:3.0:1777502233.346946:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777502233.346950:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6d200/0x4ad31463d9bc4865 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.346956:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6d200/0x4ad31463d9bc4865 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188648 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777502233.347315:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1777502233.347401:0:187571:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837563152000 00000100:00100000:0.0:1777502233.347408:0:187571:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837563152000 00000100:00100000:0.0:1777502233.347465:0:187571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3822 00000100:00100000:0.0:1777502233.347476:0:187571:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfd7f363100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4254d622-1c5a-45a0-aa2f-9afde5f83f6d+17:274351:x1863837563152000:12345-192.168.202.27@tcp:101:rm.0 00010000:00010000:0.0:1777502233.347508:0:187571:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777502233.347522:0:187571:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6d600/0x4ad31463d9bc487a lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac3ccf43bf834736 expref: -99 pid: 187571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.347574:0:187571:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6ca00/0x4ad31463d9bc4881 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 187571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.347606:0:187571:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6ca00/0x4ad31463d9bc4881 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 187571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.347618:0:187571:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6ca00/0x4ad31463d9bc4881 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 187571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.347629:0:187571:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6d800/0x4ad31463d9bc4888 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.347635:0:187571:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6d800/0x4ad31463d9bc4888 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.347640:0:187571:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6d800/0x4ad31463d9bc4888 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.347721:0:187571:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6c800/0x4ad31463d9bc488f lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x21b:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 187571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.347740:0:187571:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6c800/0x4ad31463d9bc488f lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x21b:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 187571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.347748:0:187571:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6c800/0x4ad31463d9bc488f lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x21b:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 187571 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1777502233.347789:0:187571:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd2:0x21b:0x0]: returning size 0 00000004:00200000:0.0:1777502233.347794:0:187571:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1777502233.347811:0:187571:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6c800/0x4ad31463d9bc488f lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x21b:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 187571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.347824:0:187571:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6c800/0x4ad31463d9bc488f lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x21b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 187571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.347832:0:187571:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6ca00/0x4ad31463d9bc4881 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 187571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.347838:0:187571:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6ca00/0x4ad31463d9bc4881 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 187571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.347845:0:187571:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6ca00/0x4ad31463d9bc4881 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 187571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.347852:0:187571:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfd77e6ca00 already unused, calling callback (ffffffffc1e434f0) 00010000:00010000:0.0:1777502233.347856:0:187571:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6ca00/0x4ad31463d9bc4881 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 187571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.347863:0:187571:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6ca00/0x4ad31463d9bc4881 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 187571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.347874:0:187571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffff8dfd7f712b00) 00010000:00010000:0.0:1777502233.347877:0:187571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777502233.347881:0:187571:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6ca00/0x4ad31463d9bc4881 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 187571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.347886:0:187571:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6ca00/0x4ad31463d9bc4881 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 187571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.347903:0:187571:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6d800/0x4ad31463d9bc4888 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.347908:0:187571:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6d800/0x4ad31463d9bc4888 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.347912:0:187571:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6d800/0x4ad31463d9bc4888 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.347916:0:187571:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfd77e6d800 already unused, calling callback (ffffffffc1e434f0) 00010000:00010000:0.0:1777502233.347918:0:187571:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6d800/0x4ad31463d9bc4888 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.347922:0:187571:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6d800/0x4ad31463d9bc4888 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.347929:0:187571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x6fc4c0a8 (ffff8dfd7fc41a00) 00010000:00010000:0.0:1777502233.347931:0:187571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777502233.347933:0:187571:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6d800/0x4ad31463d9bc4888 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.347937:0:187571:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6d800/0x4ad31463d9bc4888 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.347962:0:187571:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6d600/0x4ad31463d9bc487a lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xac3ccf43bf834736 expref: 19 pid: 187571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.347973:0:187571:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6c800/0x4ad31463d9bc488f lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x21b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xac3ccf43bf834736 expref: 18 pid: 187571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.347985:0:187571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x21b:0x0].0x0 (ffff8dfd5b1cfb00) 00010000:00010000:0.0:1777502233.347987:0:187571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1777502233.347989:0:187571:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dfd77e6c800, rc 0) 00000100:00100000:0.0:1777502233.348024:0:187571:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfd7f363100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4254d622-1c5a-45a0-aa2f-9afde5f83f6d+18:274351:x1863837563152000:12345-192.168.202.27@tcp:101:rm.0 Request processed in 551us (712us total) trans 0 rc 0/0 00000100:00100000:0.0:1777502233.348030:0:187571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3822 00000100:00100000:2.0:1777502233.349216:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1777502233.349269:0:186937:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837563152256 00000100:00100000:0.0:1777502233.349276:0:186937:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837563152256 00000100:00100000:0.0:1777502233.349316:0:186937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3823 00000100:00100000:0.0:1777502233.349325:0:186937:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfd7f360a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4254d622-1c5a-45a0-aa2f-9afde5f83f6d+18:274351:x1863837563152256:12345-192.168.202.27@tcp:36:rm.0 00010000:00010000:0.0:1777502233.349359:0:186937:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1777502233.349378:0:186937:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6c800/0x4ad31463d9bc488f lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x21b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xac3ccf43bf834736 expref: 18 pid: 187571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.349415:0:186937:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x21b:0x0].0x0 (ffff8dfd5b1cfb00) 00010000:00010000:0.0:1777502233.349420:0:186937:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1777502233.349433:0:186937:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6da00/0x4ad31463d9bc4896 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 186937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.349444:0:186937:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6da00/0x4ad31463d9bc4896 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 186937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.349452:0:186937:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6da00/0x4ad31463d9bc4896 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 186937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.349465:0:186937:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6de00/0x4ad31463d9bc489d lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 186937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.349483:0:186937:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6de00/0x4ad31463d9bc489d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 186937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.349502:0:186937:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6de00/0x4ad31463d9bc489d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 186937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.349618:0:186937:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6c000/0x4ad31463d9bc48a4 lrc: 3/0,1 mode: --/EX res: [0x200000bd2:0x21b:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 186937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.349630:0:186937:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd7226ee00/0x4ad31463d9bc42f4 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x21b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xac3ccf43bf834641 expref: 59 pid: 186942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.349644:0:186937:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd613a8400/0x4ad31463d9bc43f7 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x21b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xac3ccf43bf8346aa expref: 59 pid: 186941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.349652:0:186937:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd8217e400/0x4ad31463d9bc4444 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x21b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xac3ccf43bf834679 expref: 59 pid: 186942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.349660:0:186937:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6c000/0x4ad31463d9bc48a4 lrc: 6/0,1 mode: --/EX res: [0x200000bd2:0x21b:0x0].0x0 bits 0x3/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 186937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.349692:0:186937:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd8217e400/0x4ad31463d9bc4444 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x21b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xac3ccf43bf834679 expref: 59 pid: 186942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.349707:0:186937:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd8217e400/0x4ad31463d9bc4444 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x21b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xac3ccf43bf834679 expref: 59 pid: 186942 timeout: 8460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777502233.349722:0:186937:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8dfc4ddb7480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:186937:1863837561410304:192.168.202.27@tcp:104: 00010000:00010000:0.0:1777502233.349814:0:186937:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd613a8400/0x4ad31463d9bc43f7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x21b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xac3ccf43bf8346aa expref: 59 pid: 186941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.349822:0:186937:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd613a8400/0x4ad31463d9bc43f7 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x21b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xac3ccf43bf8346aa expref: 59 pid: 186941 timeout: 8460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777502233.349829:0:186937:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8dfc4ddb6680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:186937:1863837561410432:192.168.202.27@tcp:104: 00010000:00010000:0.0:1777502233.349857:0:186937:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd7226ee00/0x4ad31463d9bc42f4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x21b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xac3ccf43bf834641 expref: 59 pid: 186942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.349864:0:186937:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd7226ee00/0x4ad31463d9bc42f4 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x21b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xac3ccf43bf834641 expref: 59 pid: 186942 timeout: 8460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777502233.349870:0:186937:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8dfc4ddb4700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:186937:1863837561410560:192.168.202.27@tcp:104: 00000100:00100000:0.0:1777502233.349887:0:186937:0:(client.c:2691:ptlrpc_set_wait()) set ffff8dfc49092180 going to sleep for 11 seconds 00000100:00100000:0.0:1777502233.351015:0:186937:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8dfc4ddb7480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:186937:1863837561410304:192.168.202.27@tcp:104: 00000100:00100000:0.0:1777502233.351029:0:186937:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8dfc4ddb6680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:186937:1863837561410432:192.168.202.27@tcp:104: 00000100:00100000:0.0:1777502233.351044:0:186937:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8dfc4ddb4700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:186937:1863837561410560:192.168.202.27@tcp:104: 00010000:00010000:0.0:1777502233.351076:0:186937:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6c000/0x4ad31463d9bc48a4 lrc: 3/0,1 mode: --/EX res: [0x200000bd2:0x21b:0x0].0x0 bits 0x3/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 186937 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777502233.351209:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1777502233.351253:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1777502233.351282:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1777502233.351313:0:186922:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837563152512 00000100:00100000:3.0:1777502233.351319:0:205389:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837563152384 00000100:00100000:0.0:1777502233.351319:0:186922:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837563152512 00000100:00100000:3.0:1777502233.351326:0:205389:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837563152384 00000100:00100000:2.0:1777502233.351330:0:191872:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837563152640 00000100:00100000:2.0:1777502233.351340:0:191872:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837563152640 00010000:00010000:3.0:1777502233.351351:0:205389:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd8217e400/0x4ad31463d9bc4444 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x21b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xac3ccf43bf834679 expref: 62 pid: 186942 timeout: 8460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.351351:0:186922:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd613a8400/0x4ad31463d9bc43f7 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x21b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xac3ccf43bf8346aa expref: 62 pid: 186941 timeout: 8460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777502233.351360:0:191872:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd7226ee00/0x4ad31463d9bc42f4 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x21b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xac3ccf43bf834641 expref: 62 pid: 186942 timeout: 8460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777502233.351395:0:205389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1144 00000100:00100000:2.0:1777502233.351406:0:191872:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1145 00000100:00100000:3.0:1777502233.351408:0:205389:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfd80182450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:0775d2ab-558e-41f1-82c0-14244d133390+62:2371:x1863837563152384:12345-192.168.202.27@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1777502233.351417:0:191872:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfd7f360380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0775d2ab-558e-41f1-82c0-14244d133390+62:2371:x1863837563152640:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1777502233.351420:0:205389:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1777502233.351423:0:186922:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1146 00010000:00010000:2.0:1777502233.351425:0:191872:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1777502233.351428:0:205389:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd8217e400/0x4ad31463d9bc4444 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x21b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xac3ccf43bf834679 expref: 62 pid: 186942 timeout: 8460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777502233.351432:0:191872:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd7226ee00/0x4ad31463d9bc42f4 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x21b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xac3ccf43bf834641 expref: 62 pid: 186942 timeout: 8460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777502233.351439:0:186922:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfd7f362d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0775d2ab-558e-41f1-82c0-14244d133390+62:2370:x1863837563152512:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1777502233.351455:0:186922:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1777502233.351456:0:205389:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd8217e400/0x4ad31463d9bc4444 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x21b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xac3ccf43bf834679 expref: 62 pid: 186942 timeout: 8460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.351465:0:186922:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd613a8400/0x4ad31463d9bc43f7 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x21b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xac3ccf43bf8346aa expref: 62 pid: 186941 timeout: 8460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777502233.351471:0:191872:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd7226ee00/0x4ad31463d9bc42f4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x21b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xac3ccf43bf834641 expref: 62 pid: 186942 timeout: 8460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.351503:0:205389:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd8217e400/0x4ad31463d9bc4444 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x21b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xac3ccf43bf834679 expref: 62 pid: 186942 timeout: 8460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.351507:0:186922:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd613a8400/0x4ad31463d9bc43f7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x21b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xac3ccf43bf8346aa expref: 62 pid: 186941 timeout: 8460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777502233.351529:0:191872:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd7226ee00/0x4ad31463d9bc42f4 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x21b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xac3ccf43bf834641 expref: 61 pid: 186942 timeout: 8460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.351539:0:205389:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x21b:0x0].0x0 (ffff8dfd5b1cfb00) 00010000:00010000:0.0:1777502233.351542:0:186922:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd613a8400/0x4ad31463d9bc43f7 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x21b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xac3ccf43bf8346aa expref: 60 pid: 186941 timeout: 8460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.351546:0:205389:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6c000/0x4ad31463d9bc48a4 lrc: 3/0,1 mode: --/EX res: [0x200000bd2:0x21b:0x0].0x0 bits 0x3/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 186937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.351557:0:205389:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6c000/0x4ad31463d9bc48a4 lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x21b:0x0].0x0 bits 0x3/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 186937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.351564:0:205389:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6c000/0x4ad31463d9bc48a4 lrc: 4/0,1 mode: EX/EX res: [0x200000bd2:0x21b:0x0].0x0 bits 0x3/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 186937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777502233.351572:0:191872:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x21b:0x0].0x0 (ffff8dfd5b1cfb00) 00010000:00010000:2.0:1777502233.351576:0:191872:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1777502233.351595:0:186922:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x21b:0x0].0x0 (ffff8dfd5b1cfb00) 00010000:00010000:0.0:1777502233.351600:0:186922:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1777502233.351610:0:205389:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1777502233.351639:0:191872:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfd7f360380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0775d2ab-558e-41f1-82c0-14244d133390+59:2371:x1863837563152640:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 222us (353us total) trans 0 rc 0/0 00000100:00100000:0.0:1777502233.351641:0:186922:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfd7f362d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0775d2ab-558e-41f1-82c0-14244d133390+59:2370:x1863837563152512:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 204us (429us total) trans 0 rc 0/0 00000100:00100000:3.0:1777502233.351647:0:205389:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfd80182450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:0775d2ab-558e-41f1-82c0-14244d133390+59:2371:x1863837563152384:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 241us (391us total) trans 0 rc 0/0 00000100:00100000:2.0:1777502233.351651:0:191872:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1145 00000100:00100000:0.0:1777502233.351660:0:186922:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1146 00000100:00100000:3.0:1777502233.351667:0:205389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1144 00010000:00010000:0.0:1777502233.351720:0:186937:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6c000/0x4ad31463d9bc48a4 lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x21b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 186937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.351729:0:186937:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6c000/0x4ad31463d9bc48a4 lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x21b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 186937 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1777502233.352545:0:186937:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].534, 64 off42368 00000004:00080000:0.0:1777502233.352559:0:186937:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 8360597980129ns, next at 8361597977256ns, rc = 0 00010000:00010000:0.0:1777502233.352695:0:186937:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6ce00/0x4ad31463d9bc48ab lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x21b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 186937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.352712:0:186937:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6ce00/0x4ad31463d9bc48ab lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x21b:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 186937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.352721:0:186937:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6ce00/0x4ad31463d9bc48ab lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x21b:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 186937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.352730:0:186937:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6ce00/0x4ad31463d9bc48ab lrc: 4/0,1 mode: PW/PW res: [0x200000bd2:0x21b:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 186937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.352737:0:186937:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6ce00/0x4ad31463d9bc48ab lrc: 4/0,1 mode: PW/PW res: [0x200000bd2:0x21b:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 186937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.352744:0:186937:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6ce00/0x4ad31463d9bc48ab lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x21b:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 186937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.352766:0:186937:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1777502233.352784:0:186937:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6c000/0x4ad31463d9bc48a4 lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x21b:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 186937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.352790:0:186937:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6c000/0x4ad31463d9bc48a4 lrc: 2/0,0 mode: EX/EX res: [0x200000bd2:0x21b:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 186937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777502233.352795:0:186924:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1777502233.352798:0:186937:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6c000/0x4ad31463d9bc48a4 lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0x21b:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 186937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777502233.352803:0:186924:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6ce00/0x4ad31463d9bc48ab lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x21b:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x40010480000000 pid: 186937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.352804:0:186937:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfd77e6c000 already unused, calling callback (ffffffffc1e434f0) 00010000:00010000:0.0:1777502233.352810:0:186937:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6c000/0x4ad31463d9bc48a4 lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0x21b:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 186937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777502233.352813:0:186924:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfd77e6ce00 already unused, calling callback (ffffffffc13f52e0) 00010000:00010000:0.0:1777502233.352816:0:186937:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6c000/0x4ad31463d9bc48a4 lrc: 4/0,0 mode: EX/EX res: [0x200000bd2:0x21b:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 186937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777502233.352817:0:186924:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6ce00/0x4ad31463d9bc48ab lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x21b:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x40010480000000 pid: 186937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777502233.352853:0:186924:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6ce00/0x4ad31463d9bc48ab lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x21b:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 186937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.352853:0:186937:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x21b:0x0].0x0 (ffff8dfd5b1cfb00) 00010000:00010000:0.0:1777502233.352860:0:186937:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1777502233.352866:0:186937:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6c000/0x4ad31463d9bc48a4 lrc: 2/0,0 mode: --/EX res: [0x200000bd2:0x21b:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 186937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777502233.352869:0:186924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x21b:0x0].0x0 (ffff8dfd5b1cfb00) 00010000:00010000:2.0:1777502233.352874:0:186924:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1777502233.352876:0:186937:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6c000/0x4ad31463d9bc48a4 lrc: 0/0,0 mode: --/EX res: [0x200000bd2:0x21b:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 186937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777502233.352878:0:186924:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6ce00/0x4ad31463d9bc48ab lrc: 1/0,0 mode: --/PW res: [0x200000bd2:0x21b:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x44819480000000 pid: 186937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777502233.352893:0:186924:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6ce00/0x4ad31463d9bc48ab lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0x21b:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 186937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777502233.352905:0:186924:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777502233.352907:0:186937:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6da00/0x4ad31463d9bc4896 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 186937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777502233.352912:0:186924:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777502233.352917:0:186924:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777502233.352917:0:186937:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6da00/0x4ad31463d9bc4896 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 186937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.352925:0:186937:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6da00/0x4ad31463d9bc4896 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 186937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.352932:0:186937:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfd77e6da00 already unused, calling callback (ffffffffc1e434f0) 00010000:00010000:0.0:1777502233.352936:0:186937:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6da00/0x4ad31463d9bc4896 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 186937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.352941:0:186937:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6da00/0x4ad31463d9bc4896 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 186937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.352950:0:186937:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffff8dfd7f712b00) 00010000:00010000:0.0:1777502233.352953:0:186937:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777502233.352957:0:186937:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6da00/0x4ad31463d9bc4896 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 186937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.352963:0:186937:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6da00/0x4ad31463d9bc4896 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 186937 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1777502233.352986:0:186937:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 0000000030f5cf64 reply state 00000000ba50de37 transno 8589939070 ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6de00/0x4ad31463d9bc489d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 186937 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777502233.352996:0:186937:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1777502233.353046:0:186937:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfd7f360a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4254d622-1c5a-45a0-aa2f-9afde5f83f6d+19:274351:x1863837563152256:12345-192.168.202.27@tcp:36:rm.0 Request processed in 3723us (3833us total) trans 8589939070 rc 0/0 00000100:00100000:0.0:1777502233.353053:0:186937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3823 00010000:00010000:3.0:1777502233.353651:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6de00/0x4ad31463d9bc489d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 186937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.353661:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6de00/0x4ad31463d9bc489d lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 186937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.353668:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6de00/0x4ad31463d9bc489d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 186937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.353673:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfd77e6de00 already unused, calling callback (ffffffffc1e434f0) 00010000:00010000:3.0:1777502233.353676:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6de00/0x4ad31463d9bc489d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 186937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.353682:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6de00/0x4ad31463d9bc489d lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 186937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.353691:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x6fc4c0a8 (ffff8dfd7fc41b00) 00010000:00010000:3.0:1777502233.353693:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777502233.353696:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6de00/0x4ad31463d9bc489d lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 186937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.353702:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6de00/0x4ad31463d9bc489d lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 186937 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777502233.354057:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1777502233.354106:0:205372:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837563152768 00000100:00100000:0.0:1777502233.354112:0:205372:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837563152768 00000100:00100000:0.0:1777502233.354158:0:205372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3824 00000100:00100000:0.0:1777502233.354171:0:205372:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfd7f361180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:4254d622-1c5a-45a0-aa2f-9afde5f83f6d+18:274351:x1863837563152768:12345-192.168.202.27@tcp:101:rm.0 00010000:00010000:0.0:1777502233.354187:0:205372:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777502233.354199:0:205372:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6c200/0x4ad31463d9bc48b2 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac3ccf43bf83473d expref: -99 pid: 205372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.354260:0:205372:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6d000/0x4ad31463d9bc48b9 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 205372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.354271:0:205372:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6d000/0x4ad31463d9bc48b9 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 205372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.354282:0:205372:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6d000/0x4ad31463d9bc48b9 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 205372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.354295:0:205372:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6cc00/0x4ad31463d9bc48c0 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.354302:0:205372:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6cc00/0x4ad31463d9bc48c0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.354322:0:205372:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6cc00/0x4ad31463d9bc48c0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.354408:0:205372:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6d200/0x4ad31463d9bc48c7 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x217:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 205372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.354417:0:205372:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6d200/0x4ad31463d9bc48c7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x217:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 205372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.354426:0:205372:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6d200/0x4ad31463d9bc48c7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x217:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 205372 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1777502233.354451:0:205372:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd2:0x217:0x0]: returning size 0 00000004:00200000:0.0:1777502233.354456:0:205372:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1777502233.354469:0:205372:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6d200/0x4ad31463d9bc48c7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x217:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 205372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.354480:0:205372:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6d200/0x4ad31463d9bc48c7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x217:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 205372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.354487:0:205372:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6d000/0x4ad31463d9bc48b9 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 205372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.354505:0:205372:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6d000/0x4ad31463d9bc48b9 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 205372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.354512:0:205372:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6d000/0x4ad31463d9bc48b9 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 205372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.354518:0:205372:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfd77e6d000 already unused, calling callback (ffffffffc1e434f0) 00010000:00010000:0.0:1777502233.354522:0:205372:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6d000/0x4ad31463d9bc48b9 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 205372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.354535:0:205372:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6d000/0x4ad31463d9bc48b9 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 205372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.354546:0:205372:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffff8dfd7f712b00) 00010000:00010000:0.0:1777502233.354549:0:205372:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777502233.354553:0:205372:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6d000/0x4ad31463d9bc48b9 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 205372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.354559:0:205372:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6d000/0x4ad31463d9bc48b9 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 205372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.354572:0:205372:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6cc00/0x4ad31463d9bc48c0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.354618:0:205372:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6cc00/0x4ad31463d9bc48c0 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 205372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.354624:0:205372:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6cc00/0x4ad31463d9bc48c0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.354631:0:205372:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfd77e6cc00 already unused, calling callback (ffffffffc1e434f0) 00010000:00010000:0.0:1777502233.354635:0:205372:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6cc00/0x4ad31463d9bc48c0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.354642:0:205372:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6cc00/0x4ad31463d9bc48c0 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 205372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.354652:0:205372:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x8241c0a8 (ffff8dfd7fc41500) 00010000:00010000:0.0:1777502233.354655:0:205372:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777502233.354659:0:205372:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6cc00/0x4ad31463d9bc48c0 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.354672:0:205372:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6cc00/0x4ad31463d9bc48c0 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.354705:0:205372:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6c200/0x4ad31463d9bc48b2 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xac3ccf43bf83473d expref: 20 pid: 205372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.354720:0:205372:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6d200/0x4ad31463d9bc48c7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x217:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xac3ccf43bf83473d expref: 19 pid: 205372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.354728:0:205372:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x217:0x0].0x0 (ffff8dfd58bbe400) 00010000:00010000:0.0:1777502233.354731:0:205372:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1777502233.354735:0:205372:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dfd77e6d200, rc 0) 00000100:00100000:0.0:1777502233.354776:0:205372:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfd7f361180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:4254d622-1c5a-45a0-aa2f-9afde5f83f6d+19:274351:x1863837563152768:12345-192.168.202.27@tcp:101:rm.0 Request processed in 606us (719us total) trans 0 rc 0/0 00000100:00100000:0.0:1777502233.354783:0:205372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3824 00000100:00100000:2.0:1777502233.355934:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1777502233.355967:0:205369:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837563153024 00000100:00100000:3.0:1777502233.355974:0:205369:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837563153024 00000100:00100000:3.0:1777502233.356022:0:205369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3825 00000100:00100000:3.0:1777502233.356033:0:205369:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfd7f360e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:4254d622-1c5a-45a0-aa2f-9afde5f83f6d+19:274351:x1863837563153024:12345-192.168.202.27@tcp:36:rm.0 00010000:00010000:3.0:1777502233.356075:0:205369:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1777502233.356095:0:205369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6d200/0x4ad31463d9bc48c7 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x217:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xac3ccf43bf83473d expref: 19 pid: 205372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.356110:0:205369:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x217:0x0].0x0 (ffff8dfd58bbe400) 00010000:00010000:3.0:1777502233.356114:0:205369:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1777502233.356130:0:205369:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da56600/0x4ad31463d9bc48ce lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 205369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.356141:0:205369:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da56600/0x4ad31463d9bc48ce lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 205369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.356151:0:205369:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da56600/0x4ad31463d9bc48ce lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 205369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.356164:0:205369:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da57800/0x4ad31463d9bc48d5 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.356172:0:205369:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da57800/0x4ad31463d9bc48d5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.356181:0:205369:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da57800/0x4ad31463d9bc48d5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.356284:0:205369:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da56200/0x4ad31463d9bc48dc lrc: 3/0,1 mode: --/EX res: [0x200000bd2:0x217:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 205369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.356303:0:205369:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd58a72e00/0x4ad31463d9bc41dc lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x217:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xac3ccf43bf8345fb expref: 56 pid: 205369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.356314:0:205369:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd7f5e3a00/0x4ad31463d9bc4237 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x217:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xac3ccf43bf83461e expref: 56 pid: 186942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.356328:0:205369:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4fbbd800/0x4ad31463d9bc434f lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x217:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xac3ccf43bf83465d expref: 56 pid: 186942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.356337:0:205369:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da56200/0x4ad31463d9bc48dc lrc: 6/0,1 mode: --/EX res: [0x200000bd2:0x217:0x0].0x0 bits 0x3/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 205369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.356367:0:205369:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4fbbd800/0x4ad31463d9bc434f lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x217:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xac3ccf43bf83465d expref: 56 pid: 186942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.356383:0:205369:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4fbbd800/0x4ad31463d9bc434f lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x217:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xac3ccf43bf83465d expref: 56 pid: 186942 timeout: 8460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777502233.356398:0:205369:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8dfd7c2ffb80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:205369:1863837561410688:192.168.202.27@tcp:104: 00010000:00010000:3.0:1777502233.356476:0:205369:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd7f5e3a00/0x4ad31463d9bc4237 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x217:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xac3ccf43bf83461e expref: 56 pid: 186942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.356502:0:205369:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd7f5e3a00/0x4ad31463d9bc4237 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x217:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xac3ccf43bf83461e expref: 56 pid: 186942 timeout: 8460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777502233.356515:0:205369:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8dfd7c2fd500 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:205369:1863837561410816:192.168.202.27@tcp:104: 00010000:00010000:3.0:1777502233.356560:0:205369:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd58a72e00/0x4ad31463d9bc41dc lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x217:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xac3ccf43bf8345fb expref: 56 pid: 205369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.356571:0:205369:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd58a72e00/0x4ad31463d9bc41dc lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x217:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xac3ccf43bf8345fb expref: 56 pid: 205369 timeout: 8460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777502233.356695:0:205369:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8dfd7c2fed80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:205369:1863837561410944:192.168.202.27@tcp:104: 00000100:00100000:3.0:1777502233.356839:0:205369:0:(client.c:2691:ptlrpc_set_wait()) set ffff8dfc45a25600 going to sleep for 11 seconds 00000100:00100000:3.0:1777502233.357294:0:205369:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8dfd7c2ffb80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:205369:1863837561410688:192.168.202.27@tcp:104: 00000100:00100000:2.0:1777502233.357567:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1777502233.357596:0:205369:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8dfd7c2fd500 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:205369:1863837561410816:192.168.202.27@tcp:104: 00000100:00100000:0.0:1777502233.357627:0:186923:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837563153152 00000100:00100000:0.0:1777502233.357633:0:186923:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837563153152 00010000:00010000:0.0:1777502233.357656:0:186923:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4fbbd800/0x4ad31463d9bc434f lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x217:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xac3ccf43bf83465d expref: 57 pid: 186942 timeout: 8460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777502233.357686:0:186923:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1147 00000100:00100000:0.0:1777502233.357695:0:186923:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfd7f360000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0775d2ab-558e-41f1-82c0-14244d133390+57:2370:x1863837563153152:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1777502233.357703:0:186923:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1777502233.357707:0:186923:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4fbbd800/0x4ad31463d9bc434f lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x217:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xac3ccf43bf83465d expref: 57 pid: 186942 timeout: 8460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.357732:0:186923:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4fbbd800/0x4ad31463d9bc434f lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x217:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xac3ccf43bf83465d expref: 57 pid: 186942 timeout: 8460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.357750:0:186923:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4fbbd800/0x4ad31463d9bc434f lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x217:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xac3ccf43bf83465d expref: 57 pid: 186942 timeout: 8460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.357765:0:186923:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x217:0x0].0x0 (ffff8dfd58bbe400) 00010000:00010000:0.0:1777502233.357770:0:186923:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da56200/0x4ad31463d9bc48dc lrc: 3/0,1 mode: --/EX res: [0x200000bd2:0x217:0x0].0x0 bits 0x3/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 205369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.357777:0:186923:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da56200/0x4ad31463d9bc48dc lrc: 3/0,1 mode: --/EX res: [0x200000bd2:0x217:0x0].0x0 bits 0x3/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 205369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.357781:0:186923:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1777502233.358312:0:186923:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfd7f360000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0775d2ab-558e-41f1-82c0-14244d133390+56:2370:x1863837563153152:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 617us (746us total) trans 0 rc 0/0 00000100:00100000:0.0:1777502233.358331:0:186923:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1147 00000100:00100000:2.0:1777502233.358352:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1777502233.358364:0:186923:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837563153280 00000100:00100000:0.0:1777502233.358368:0:186923:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837563153280 00010000:00010000:0.0:1777502233.358387:0:186923:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd7f5e3a00/0x4ad31463d9bc4237 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x217:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xac3ccf43bf83461e expref: 56 pid: 186942 timeout: 8460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777502233.358424:0:186923:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1148 00000100:00100000:0.0:1777502233.358434:0:186923:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfd7f361500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0775d2ab-558e-41f1-82c0-14244d133390+56:2371:x1863837563153280:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1777502233.358444:0:186923:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1777502233.358450:0:186923:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd7f5e3a00/0x4ad31463d9bc4237 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x217:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xac3ccf43bf83461e expref: 56 pid: 186942 timeout: 8460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.358469:0:186923:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd7f5e3a00/0x4ad31463d9bc4237 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x217:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xac3ccf43bf83461e expref: 56 pid: 186942 timeout: 8460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.358486:0:186923:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd7f5e3a00/0x4ad31463d9bc4237 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x217:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xac3ccf43bf83461e expref: 56 pid: 186942 timeout: 8460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777502233.358501:0:205369:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8dfd7c2fed80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:205369:1863837561410944:192.168.202.27@tcp:104: 00010000:00010000:0.0:1777502233.358516:0:186923:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x217:0x0].0x0 (ffff8dfd58bbe400) 00010000:00010000:0.0:1777502233.358520:0:186923:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da56200/0x4ad31463d9bc48dc lrc: 3/0,1 mode: --/EX res: [0x200000bd2:0x217:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 205369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.358532:0:186923:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da56200/0x4ad31463d9bc48dc lrc: 3/0,1 mode: --/EX res: [0x200000bd2:0x217:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 205369 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777502233.358537:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:0.0:1777502233.358545:0:186923:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1777502233.358551:0:205369:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da56200/0x4ad31463d9bc48dc lrc: 3/0,1 mode: --/EX res: [0x200000bd2:0x217:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 205369 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777502233.358558:0:205589:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837563153408 00000100:00100000:2.0:1777502233.358562:0:205589:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837563153408 00000100:00100000:0.0:1777502233.358600:0:186923:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfd7f361500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0775d2ab-558e-41f1-82c0-14244d133390+56:2371:x1863837563153280:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 148us (232us total) trans 0 rc 0/0 00010000:00010000:2.0:1777502233.358603:0:205589:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd58a72e00/0x4ad31463d9bc41dc lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x217:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xac3ccf43bf8345fb expref: 56 pid: 205369 timeout: 8460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777502233.358614:0:186923:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1148 00000100:00100000:2.0:1777502233.358638:0:205589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1149 00000100:00100000:2.0:1777502233.358646:0:205589:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfd7f363800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:0775d2ab-558e-41f1-82c0-14244d133390+55:2370:x1863837563153408:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1777502233.358655:0:205589:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1777502233.358659:0:205589:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd58a72e00/0x4ad31463d9bc41dc lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x217:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xac3ccf43bf8345fb expref: 55 pid: 205369 timeout: 8460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777502233.358677:0:205589:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd58a72e00/0x4ad31463d9bc41dc lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x217:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xac3ccf43bf8345fb expref: 55 pid: 205369 timeout: 8460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777502233.358690:0:205589:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd58a72e00/0x4ad31463d9bc41dc lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x217:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xac3ccf43bf8345fb expref: 55 pid: 205369 timeout: 8460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777502233.358707:0:205589:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x217:0x0].0x0 (ffff8dfd58bbe400) 00010000:00010000:2.0:1777502233.358711:0:205589:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da56200/0x4ad31463d9bc48dc lrc: 3/0,1 mode: --/EX res: [0x200000bd2:0x217:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 205369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777502233.358719:0:205589:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da56200/0x4ad31463d9bc48dc lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x217:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 205369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777502233.358726:0:205589:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da56200/0x4ad31463d9bc48dc lrc: 4/0,1 mode: EX/EX res: [0x200000bd2:0x217:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 205369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777502233.358746:0:205589:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1777502233.358763:0:205369:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da56200/0x4ad31463d9bc48dc lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x217:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 205369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.358772:0:205369:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da56200/0x4ad31463d9bc48dc lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x217:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 205369 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777502233.358775:0:205589:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfd7f363800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:0775d2ab-558e-41f1-82c0-14244d133390+54:2370:x1863837563153408:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 130us (242us total) trans 0 rc 0/0 00000100:00100000:2.0:1777502233.358789:0:205589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1149 00000040:00080000:3.0:1777502233.359673:0:205369:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].535, 64 off42432 00010000:00010000:3.0:1777502233.359746:0:205369:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da57000/0x4ad31463d9bc48e3 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x217:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 205369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.359757:0:205369:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da57000/0x4ad31463d9bc48e3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x217:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 205369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.359767:0:205369:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da57000/0x4ad31463d9bc48e3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x217:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 205369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.359775:0:205369:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da57000/0x4ad31463d9bc48e3 lrc: 4/0,1 mode: PW/PW res: [0x200000bd2:0x217:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 205369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.359781:0:205369:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da57000/0x4ad31463d9bc48e3 lrc: 4/0,1 mode: PW/PW res: [0x200000bd2:0x217:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 205369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.359796:0:205369:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da57000/0x4ad31463d9bc48e3 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x217:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 205369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.359817:0:205369:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1777502233.359836:0:205369:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da56200/0x4ad31463d9bc48dc lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x217:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 205369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.359837:0:186925:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1777502233.359844:0:186925:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da57000/0x4ad31463d9bc48e3 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x217:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x40010480000000 pid: 205369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.359846:0:205369:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da56200/0x4ad31463d9bc48dc lrc: 2/0,0 mode: EX/EX res: [0x200000bd2:0x217:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 205369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.359861:0:205369:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da56200/0x4ad31463d9bc48dc lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0x217:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 205369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.359863:0:186925:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfd4da57000 already unused, calling callback (ffffffffc13f52e0) 00010000:00010000:0.0:1777502233.359868:0:186925:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da57000/0x4ad31463d9bc48e3 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x217:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x40010480000000 pid: 205369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.359870:0:205369:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfd4da56200 already unused, calling callback (ffffffffc1e434f0) 00010000:00010000:3.0:1777502233.359877:0:205369:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da56200/0x4ad31463d9bc48dc lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0x217:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 205369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.359879:0:186925:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da57000/0x4ad31463d9bc48e3 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x217:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x40018480000000 pid: 205369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.359889:0:205369:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da56200/0x4ad31463d9bc48dc lrc: 4/0,0 mode: EX/EX res: [0x200000bd2:0x217:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 205369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.359906:0:205369:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x217:0x0].0x0 (ffff8dfd58bbe400) 00010000:00010000:3.0:1777502233.359911:0:205369:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1777502233.359916:0:205369:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da56200/0x4ad31463d9bc48dc lrc: 2/0,0 mode: --/EX res: [0x200000bd2:0x217:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 205369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.359921:0:186925:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x217:0x0].0x0 (ffff8dfd58bbe400) 00010000:00010000:3.0:1777502233.359923:0:205369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da56200/0x4ad31463d9bc48dc lrc: 0/0,0 mode: --/EX res: [0x200000bd2:0x217:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 205369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.359925:0:186925:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1777502233.359929:0:186925:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da57000/0x4ad31463d9bc48e3 lrc: 1/0,0 mode: --/PW res: [0x200000bd2:0x217:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x44819480000000 pid: 205369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.359935:0:186925:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da57000/0x4ad31463d9bc48e3 lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0x217:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 205369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.359946:0:205369:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da56600/0x4ad31463d9bc48ce lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 205369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.359951:0:186925:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777502233.359954:0:186925:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777502233.359957:0:186925:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777502233.359962:0:205369:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da56600/0x4ad31463d9bc48ce lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 205369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.359969:0:205369:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da56600/0x4ad31463d9bc48ce lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 205369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.359975:0:205369:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfd4da56600 already unused, calling callback (ffffffffc1e434f0) 00010000:00010000:3.0:1777502233.359979:0:205369:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da56600/0x4ad31463d9bc48ce lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 205369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.359986:0:205369:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da56600/0x4ad31463d9bc48ce lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 205369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.359998:0:205369:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffff8dfd7f712b00) 00010000:00010000:3.0:1777502233.360001:0:205369:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777502233.360005:0:205369:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da56600/0x4ad31463d9bc48ce lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 205369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.360011:0:205369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da56600/0x4ad31463d9bc48ce lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 205369 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1777502233.360025:0:205369:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 0000000045b1b79a reply state 00000000e044af40 transno 8589939071 ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da57800/0x4ad31463d9bc48d5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205369 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777502233.360033:0:205369:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1777502233.360111:0:205369:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfd7f360e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:4254d622-1c5a-45a0-aa2f-9afde5f83f6d+20:274351:x1863837563153024:12345-192.168.202.27@tcp:36:rm.0 Request processed in 4080us (4180us total) trans 8589939071 rc 0/0 00000100:00100000:3.0:1777502233.360118:0:205369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3825 00010000:00010000:3.0:1777502233.360730:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da57800/0x4ad31463d9bc48d5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.360750:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da57800/0x4ad31463d9bc48d5 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 205369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.360757:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da57800/0x4ad31463d9bc48d5 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.360764:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfd4da57800 already unused, calling callback (ffffffffc1e434f0) 00010000:00010000:3.0:1777502233.360768:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da57800/0x4ad31463d9bc48d5 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.360775:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da57800/0x4ad31463d9bc48d5 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 205369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.360786:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x8241c0a8 (ffff8dfd47d8b700) 00010000:00010000:3.0:1777502233.360789:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777502233.360792:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da57800/0x4ad31463d9bc48d5 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.360799:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da57800/0x4ad31463d9bc48d5 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205369 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777502233.361151:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1777502233.361195:0:186936:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837563153536 00000100:00100000:2.0:1777502233.361202:0:186936:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837563153536 00000100:00100000:2.0:1777502233.361259:0:186936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3826 00000100:00100000:2.0:1777502233.361270:0:186936:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfc4ddb4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4254d622-1c5a-45a0-aa2f-9afde5f83f6d+19:274351:x1863837563153536:12345-192.168.202.27@tcp:101:rm.0 00010000:00010000:2.0:1777502233.361289:0:186936:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777502233.361302:0:186936:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd7eec8a00/0x4ad31463d9bc48ea lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac3ccf43bf834744 expref: -99 pid: 186936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777502233.361376:0:186936:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd7eec9c00/0x4ad31463d9bc48f1 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 186936 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777502233.361387:0:186936:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd7eec9c00/0x4ad31463d9bc48f1 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 186936 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777502233.361394:0:186936:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd7eec9c00/0x4ad31463d9bc48f1 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 186936 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777502233.361404:0:186936:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd7eec9000/0x4ad31463d9bc48f8 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x145c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 186936 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777502233.361408:0:186936:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd7eec9000/0x4ad31463d9bc48f8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 186936 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777502233.361413:0:186936:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd7eec9000/0x4ad31463d9bc48f8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 186936 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777502233.361518:0:186936:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd7eec9800/0x4ad31463d9bc48ff lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x213:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 186936 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777502233.361527:0:186936:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd7eec9800/0x4ad31463d9bc48ff lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x213:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 186936 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777502233.361535:0:186936:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd7eec9800/0x4ad31463d9bc48ff lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x213:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 186936 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1777502233.361563:0:186936:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd2:0x213:0x0]: returning size 0 00000004:00200000:2.0:1777502233.361567:0:186936:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1777502233.361613:0:186936:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd7eec9800/0x4ad31463d9bc48ff lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x213:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 186936 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777502233.361634:0:186936:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd7eec9800/0x4ad31463d9bc48ff lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x213:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 186936 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777502233.361642:0:186936:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd7eec9c00/0x4ad31463d9bc48f1 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 186936 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777502233.361648:0:186936:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd7eec9c00/0x4ad31463d9bc48f1 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 186936 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777502233.361655:0:186936:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd7eec9c00/0x4ad31463d9bc48f1 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 186936 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777502233.361661:0:186936:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfd7eec9c00 already unused, calling callback (ffffffffc1e434f0) 00010000:00010000:2.0:1777502233.361664:0:186936:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd7eec9c00/0x4ad31463d9bc48f1 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 186936 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777502233.361670:0:186936:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd7eec9c00/0x4ad31463d9bc48f1 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 186936 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777502233.361680:0:186936:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffff8dfd7f712b00) 00010000:00010000:2.0:1777502233.361683:0:186936:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777502233.361687:0:186936:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd7eec9c00/0x4ad31463d9bc48f1 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 186936 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777502233.361693:0:186936:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd7eec9c00/0x4ad31463d9bc48f1 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 186936 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777502233.361705:0:186936:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd7eec9000/0x4ad31463d9bc48f8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 186936 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777502233.361712:0:186936:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd7eec9000/0x4ad31463d9bc48f8 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 186936 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777502233.361723:0:186936:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd7eec9000/0x4ad31463d9bc48f8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 186936 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777502233.361730:0:186936:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfd7eec9000 already unused, calling callback (ffffffffc1e434f0) 00010000:00010000:2.0:1777502233.361734:0:186936:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd7eec9000/0x4ad31463d9bc48f8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 186936 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777502233.361740:0:186936:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd7eec9000/0x4ad31463d9bc48f8 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 186936 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777502233.361750:0:186936:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x145c0a8 (ffff8dfd80102000) 00010000:00010000:2.0:1777502233.361753:0:186936:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777502233.361757:0:186936:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd7eec9000/0x4ad31463d9bc48f8 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 186936 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777502233.361763:0:186936:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd7eec9000/0x4ad31463d9bc48f8 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 186936 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777502233.361795:0:186936:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd7eec8a00/0x4ad31463d9bc48ea lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xac3ccf43bf834744 expref: 21 pid: 186936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777502233.361821:0:186936:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd7eec9800/0x4ad31463d9bc48ff lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x213:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xac3ccf43bf834744 expref: 20 pid: 186936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777502233.361829:0:186936:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x213:0x0].0x0 (ffff8dfd58bbe600) 00010000:00010000:2.0:1777502233.361832:0:186936:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1777502233.361835:0:186936:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dfd7eec9800, rc 0) 00000100:00100000:2.0:1777502233.361881:0:186936:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfc4ddb4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4254d622-1c5a-45a0-aa2f-9afde5f83f6d+20:274351:x1863837563153536:12345-192.168.202.27@tcp:101:rm.0 Request processed in 613us (732us total) trans 0 rc 0/0 00000100:00100000:2.0:1777502233.361897:0:186936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3826 00000100:00100000:2.0:1777502233.363210:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1777502233.363260:0:188648:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837563153792 00000100:00100000:0.0:1777502233.363268:0:188648:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837563153792 00000100:00100000:0.0:1777502233.363321:0:188648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3827 00000100:00100000:0.0:1777502233.363333:0:188648:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfd7f361c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4254d622-1c5a-45a0-aa2f-9afde5f83f6d+20:274351:x1863837563153792:12345-192.168.202.27@tcp:36:rm.0 00010000:00010000:0.0:1777502233.363372:0:188648:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1777502233.363397:0:188648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd7eec9800/0x4ad31463d9bc48ff lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x213:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xac3ccf43bf834744 expref: 20 pid: 186936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.363413:0:188648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x213:0x0].0x0 (ffff8dfd58bbe600) 00010000:00010000:0.0:1777502233.363419:0:188648:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1777502233.363435:0:188648:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6c200/0x4ad31463d9bc4906 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 188648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.363446:0:188648:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6c200/0x4ad31463d9bc4906 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 188648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.363456:0:188648:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6c200/0x4ad31463d9bc4906 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 188648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.363478:0:188648:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6cc00/0x4ad31463d9bc490d lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0x145c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.363487:0:188648:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6cc00/0x4ad31463d9bc490d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.363510:0:188648:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6cc00/0x4ad31463d9bc490d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.363637:0:188648:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6d000/0x4ad31463d9bc4914 lrc: 3/0,1 mode: --/EX res: [0x200000bd2:0x213:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 188648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.363647:0:188648:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd58a72a00/0x4ad31463d9bc401c lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x213:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xac3ccf43bf834537 expref: 53 pid: 186937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.363653:0:188648:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6d000/0x4ad31463d9bc4914 lrc: 4/0,1 mode: --/EX res: [0x200000bd2:0x213:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.363681:0:188648:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd58a72a00/0x4ad31463d9bc401c lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x213:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xac3ccf43bf834537 expref: 53 pid: 186937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.363695:0:188648:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd58a72a00/0x4ad31463d9bc401c lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x213:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xac3ccf43bf834537 expref: 53 pid: 186937 timeout: 8460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777502233.363709:0:188648:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8dfc4ddb6680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:188648:1863837561411072:192.168.202.27@tcp:104: 00000100:00100000:0.0:1777502233.363796:0:188648:0:(client.c:2691:ptlrpc_set_wait()) set ffff8dfc49092e40 going to sleep for 11 seconds 00000100:00100000:0.0:1777502233.364792:0:188648:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8dfc4ddb6680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:188648:1863837561411072:192.168.202.27@tcp:104: 00010000:00010000:0.0:1777502233.364822:0:188648:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6d000/0x4ad31463d9bc4914 lrc: 3/0,1 mode: --/EX res: [0x200000bd2:0x213:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 188648 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777502233.364894:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1777502233.364935:0:205388:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837563153920 00000100:00100000:0.0:1777502233.364941:0:205388:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837563153920 00010000:00010000:0.0:1777502233.364975:0:205388:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd58a72a00/0x4ad31463d9bc401c lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x213:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xac3ccf43bf834537 expref: 54 pid: 186937 timeout: 8460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777502233.365011:0:205388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1150 00000100:00100000:0.0:1777502233.365022:0:205388:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfd7f362d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:0775d2ab-558e-41f1-82c0-14244d133390+54:2371:x1863837563153920:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1777502233.365034:0:205388:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1777502233.365040:0:205388:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd58a72a00/0x4ad31463d9bc401c lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x213:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xac3ccf43bf834537 expref: 54 pid: 186937 timeout: 8460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.365055:0:205388:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd58a72a00/0x4ad31463d9bc401c lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x213:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xac3ccf43bf834537 expref: 54 pid: 186937 timeout: 8460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.365076:0:205388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd58a72a00/0x4ad31463d9bc401c lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x213:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xac3ccf43bf834537 expref: 54 pid: 186937 timeout: 8460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.365090:0:205388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x213:0x0].0x0 (ffff8dfd58bbe600) 00010000:00010000:0.0:1777502233.365095:0:205388:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6d000/0x4ad31463d9bc4914 lrc: 3/0,1 mode: --/EX res: [0x200000bd2:0x213:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 188648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.365103:0:205388:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6d000/0x4ad31463d9bc4914 lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x213:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 188648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.365110:0:205388:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6d000/0x4ad31463d9bc4914 lrc: 4/0,1 mode: EX/EX res: [0x200000bd2:0x213:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 188648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.365137:0:205388:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1777502233.365161:0:188648:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6d000/0x4ad31463d9bc4914 lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x213:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777502233.365170:0:188648:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6d000/0x4ad31463d9bc4914 lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x213:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188648 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777502233.365183:0:205388:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfd7f362d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:0775d2ab-558e-41f1-82c0-14244d133390+53:2371:x1863837563153920:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 163us (290us total) trans 0 rc 0/0 00000100:00100000:0.0:1777502233.365192:0:205388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1150 00000040:00080000:2.0:1777502233.365913:0:188648:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].536, 64 off42496 00010000:00010000:2.0:1777502233.366006:0:188648:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd7eec8000/0x4ad31463d9bc491b lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x213:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 188648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777502233.366017:0:188648:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd7eec8000/0x4ad31463d9bc491b lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x213:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 188648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777502233.366026:0:188648:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd7eec8000/0x4ad31463d9bc491b lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x213:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 188648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777502233.366034:0:188648:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd7eec8000/0x4ad31463d9bc491b lrc: 4/0,1 mode: PW/PW res: [0x200000bd2:0x213:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 188648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777502233.366041:0:188648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd7eec8000/0x4ad31463d9bc491b lrc: 4/0,1 mode: PW/PW res: [0x200000bd2:0x213:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 188648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777502233.366048:0:188648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd7eec8000/0x4ad31463d9bc491b lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x213:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 188648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777502233.366068:0:188648:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1777502233.366086:0:188648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6d000/0x4ad31463d9bc4914 lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x213:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.366090:0:205387:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1777502233.366096:0:205387:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd7eec8000/0x4ad31463d9bc491b lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x213:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x40010480000000 pid: 188648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777502233.366113:0:188648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6d000/0x4ad31463d9bc4914 lrc: 2/0,0 mode: EX/EX res: [0x200000bd2:0x213:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 188648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.366119:0:205387:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfd7eec8000 already unused, calling callback (ffffffffc13f52e0) 00010000:00010000:2.0:1777502233.366120:0:188648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6d000/0x4ad31463d9bc4914 lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0x213:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 188648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.366125:0:205387:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd7eec8000/0x4ad31463d9bc491b lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x213:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x40010480000000 pid: 188648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777502233.366130:0:188648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfd77e6d000 already unused, calling callback (ffffffffc1e434f0) 00010000:00010000:0.0:1777502233.366135:0:205387:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd7eec8000/0x4ad31463d9bc491b lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x213:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 188648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777502233.366136:0:188648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6d000/0x4ad31463d9bc4914 lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0x213:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 188648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.366160:0:205387:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x213:0x0].0x0 (ffff8dfd58bbe600) 00010000:00010000:2.0:1777502233.366161:0:188648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6d000/0x4ad31463d9bc4914 lrc: 4/0,0 mode: EX/EX res: [0x200000bd2:0x213:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 188648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.366167:0:205387:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1777502233.366173:0:205387:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd7eec8000/0x4ad31463d9bc491b lrc: 1/0,0 mode: --/PW res: [0x200000bd2:0x213:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 188648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777502233.366178:0:188648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x213:0x0].0x0 (ffff8dfd58bbe600) 00010000:00010000:0.0:1777502233.366180:0:205387:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd7eec8000/0x4ad31463d9bc491b lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0x213:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 188648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777502233.366183:0:188648:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1777502233.366188:0:188648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6d000/0x4ad31463d9bc4914 lrc: 2/0,0 mode: --/EX res: [0x200000bd2:0x213:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 188648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777502233.366196:0:188648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6d000/0x4ad31463d9bc4914 lrc: 0/0,0 mode: --/EX res: [0x200000bd2:0x213:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.366197:0:205387:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777502233.366202:0:205387:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777502233.366206:0:205387:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777502233.366218:0:188648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6c200/0x4ad31463d9bc4906 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 188648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777502233.366226:0:188648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6c200/0x4ad31463d9bc4906 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 188648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777502233.366232:0:188648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6c200/0x4ad31463d9bc4906 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 188648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777502233.366238:0:188648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfd77e6c200 already unused, calling callback (ffffffffc1e434f0) 00010000:00010000:2.0:1777502233.366249:0:188648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6c200/0x4ad31463d9bc4906 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 188648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777502233.366256:0:188648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6c200/0x4ad31463d9bc4906 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 188648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777502233.366267:0:188648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffff8dfd7f712b00) 00010000:00010000:2.0:1777502233.366270:0:188648:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777502233.366275:0:188648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6c200/0x4ad31463d9bc4906 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 188648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777502233.366282:0:188648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6c200/0x4ad31463d9bc4906 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 188648 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1777502233.366294:0:188648:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000006e741a51 reply state 00000000a9f67f6b transno 8589939072 ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6cc00/0x4ad31463d9bc490d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188648 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777502233.366304:0:188648:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1777502233.366366:0:188648:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfd7f361c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4254d622-1c5a-45a0-aa2f-9afde5f83f6d+21:274351:x1863837563153792:12345-192.168.202.27@tcp:36:rm.0 Request processed in 3034us (3158us total) trans 8589939072 rc 0/0 00000100:00100000:2.0:1777502233.366375:0:188648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3827 00010000:00010000:3.0:1777502233.366945:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6cc00/0x4ad31463d9bc490d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.366955:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6cc00/0x4ad31463d9bc490d lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.366961:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6cc00/0x4ad31463d9bc490d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.366966:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfd77e6cc00 already unused, calling callback (ffffffffc1e434f0) 00010000:00010000:3.0:1777502233.366974:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6cc00/0x4ad31463d9bc490d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.366980:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6cc00/0x4ad31463d9bc490d lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.366991:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x145c0a8 (ffff8dfd7fc41500) 00010000:00010000:3.0:1777502233.366995:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777502233.366998:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6cc00/0x4ad31463d9bc490d lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.367005:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6cc00/0x4ad31463d9bc490d lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188648 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777502233.367332:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1777502233.367378:0:187571:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837563154048 00000100:00100000:0.0:1777502233.367384:0:187571:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837563154048 00000100:00100000:0.0:1777502233.367427:0:187571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3828 00000100:00100000:0.0:1777502233.367440:0:187571:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfd7c2fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4254d622-1c5a-45a0-aa2f-9afde5f83f6d+20:274351:x1863837563154048:12345-192.168.202.27@tcp:101:rm.0 00010000:00010000:0.0:1777502233.367460:0:187571:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777502233.367482:0:187571:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6c800/0x4ad31463d9bc4922 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac3ccf43bf83474b expref: -99 pid: 187571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.367546:0:187571:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6d600/0x4ad31463d9bc4929 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 187571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.367558:0:187571:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6d600/0x4ad31463d9bc4929 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 187571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.367568:0:187571:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6d600/0x4ad31463d9bc4929 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 187571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.367610:0:187571:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6d800/0x4ad31463d9bc4930 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.367620:0:187571:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6d800/0x4ad31463d9bc4930 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.367628:0:187571:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6d800/0x4ad31463d9bc4930 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.367726:0:187571:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6ca00/0x4ad31463d9bc4937 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x21a:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 187571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.367748:0:187571:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6ca00/0x4ad31463d9bc4937 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x21a:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 187571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.367756:0:187571:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6ca00/0x4ad31463d9bc4937 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x21a:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 187571 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1777502233.367818:0:187571:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd2:0x21a:0x0]: returning size 0 00000004:00200000:0.0:1777502233.367821:0:187571:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1777502233.367835:0:187571:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6ca00/0x4ad31463d9bc4937 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x21a:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 187571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.367854:0:187571:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6ca00/0x4ad31463d9bc4937 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x21a:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 187571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.367862:0:187571:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6d600/0x4ad31463d9bc4929 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 187571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.367868:0:187571:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6d600/0x4ad31463d9bc4929 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 187571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.367875:0:187571:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6d600/0x4ad31463d9bc4929 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 187571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.367882:0:187571:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfd77e6d600 already unused, calling callback (ffffffffc1e434f0) 00010000:00010000:0.0:1777502233.367886:0:187571:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6d600/0x4ad31463d9bc4929 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 187571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.367893:0:187571:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6d600/0x4ad31463d9bc4929 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 187571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.367902:0:187571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffff8dfd7f712b00) 00010000:00010000:0.0:1777502233.367904:0:187571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777502233.367907:0:187571:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6d600/0x4ad31463d9bc4929 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 187571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.367911:0:187571:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6d600/0x4ad31463d9bc4929 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 187571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.367920:0:187571:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6d800/0x4ad31463d9bc4930 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.367924:0:187571:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6d800/0x4ad31463d9bc4930 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.367933:0:187571:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6d800/0x4ad31463d9bc4930 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.367937:0:187571:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfd77e6d800 already unused, calling callback (ffffffffc1e434f0) 00010000:00010000:0.0:1777502233.367939:0:187571:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6d800/0x4ad31463d9bc4930 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.367944:0:187571:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6d800/0x4ad31463d9bc4930 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.367951:0:187571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x7516c0a8 (ffff8dfd7fc41a00) 00010000:00010000:0.0:1777502233.367953:0:187571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777502233.367955:0:187571:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6d800/0x4ad31463d9bc4930 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.367959:0:187571:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6d800/0x4ad31463d9bc4930 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.367984:0:187571:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6c800/0x4ad31463d9bc4922 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xac3ccf43bf83474b expref: 22 pid: 187571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.367998:0:187571:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6ca00/0x4ad31463d9bc4937 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x21a:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xac3ccf43bf83474b expref: 21 pid: 187571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.368006:0:187571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x21a:0x0].0x0 (ffff8dfd5b1cf600) 00010000:00010000:0.0:1777502233.368009:0:187571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1777502233.368012:0:187571:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dfd77e6ca00, rc 0) 00000100:00100000:0.0:1777502233.368052:0:187571:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfd7c2fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4254d622-1c5a-45a0-aa2f-9afde5f83f6d+21:274351:x1863837563154048:12345-192.168.202.27@tcp:101:rm.0 Request processed in 615us (720us total) trans 0 rc 0/0 00000100:00100000:0.0:1777502233.368069:0:187571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3828 00000100:00100000:2.0:1777502233.369274:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1777502233.369330:0:186937:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837563154304 00000100:00100000:0.0:1777502233.369337:0:186937:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837563154304 00000100:00100000:0.0:1777502233.369384:0:186937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3829 00000100:00100000:0.0:1777502233.369394:0:186937:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfc4a058000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4254d622-1c5a-45a0-aa2f-9afde5f83f6d+21:274351:x1863837563154304:12345-192.168.202.27@tcp:36:rm.0 00010000:00010000:0.0:1777502233.369428:0:186937:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1777502233.369446:0:186937:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6ca00/0x4ad31463d9bc4937 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x21a:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xac3ccf43bf83474b expref: 21 pid: 187571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.369461:0:186937:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x21a:0x0].0x0 (ffff8dfd5b1cf600) 00010000:00010000:0.0:1777502233.369466:0:186937:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1777502233.369478:0:186937:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6dc00/0x4ad31463d9bc493e lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 186937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.369500:0:186937:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6dc00/0x4ad31463d9bc493e lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 186937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.369511:0:186937:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6dc00/0x4ad31463d9bc493e lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 186937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.369526:0:186937:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6d200/0x4ad31463d9bc4945 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 186937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.369535:0:186937:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6d200/0x4ad31463d9bc4945 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 186937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.369543:0:186937:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6d200/0x4ad31463d9bc4945 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 186937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.369674:0:186937:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6c000/0x4ad31463d9bc494c lrc: 3/0,1 mode: --/EX res: [0x200000bd2:0x21a:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 186937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.369687:0:186937:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd7226f200/0x4ad31463d9bc42bc lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x21a:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xac3ccf43bf834633 expref: 52 pid: 186942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.369697:0:186937:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd67665800/0x4ad31463d9bc43cd lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x21a:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xac3ccf43bf8346a3 expref: 52 pid: 186941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.369706:0:186937:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd6b122200/0x4ad31463d9bc4413 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x21a:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xac3ccf43bf834672 expref: 52 pid: 186942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.369715:0:186937:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6c000/0x4ad31463d9bc494c lrc: 6/0,1 mode: --/EX res: [0x200000bd2:0x21a:0x0].0x0 bits 0x3/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 186937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.369755:0:186937:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd6b122200/0x4ad31463d9bc4413 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x21a:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xac3ccf43bf834672 expref: 52 pid: 186942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.369770:0:186937:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd6b122200/0x4ad31463d9bc4413 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x21a:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xac3ccf43bf834672 expref: 52 pid: 186942 timeout: 8460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777502233.369785:0:186937:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8dfc4ddb6680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:186937:1863837561411200:192.168.202.27@tcp:104: 00010000:00010000:0.0:1777502233.369870:0:186937:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd67665800/0x4ad31463d9bc43cd lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x21a:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xac3ccf43bf8346a3 expref: 52 pid: 186941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.369882:0:186937:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd67665800/0x4ad31463d9bc43cd lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x21a:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xac3ccf43bf8346a3 expref: 52 pid: 186941 timeout: 8460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777502233.369906:0:186937:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8dfc4ddb7480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:186937:1863837561411328:192.168.202.27@tcp:104: 00010000:00010000:0.0:1777502233.369954:0:186937:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd7226f200/0x4ad31463d9bc42bc lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x21a:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xac3ccf43bf834633 expref: 52 pid: 186942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.369966:0:186937:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd7226f200/0x4ad31463d9bc42bc lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x21a:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xac3ccf43bf834633 expref: 52 pid: 186942 timeout: 8460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777502233.369978:0:186937:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8dfc4ddb7800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:186937:1863837561411456:192.168.202.27@tcp:104: 00000100:00100000:0.0:1777502233.370063:0:186937:0:(client.c:2691:ptlrpc_set_wait()) set ffff8dfc49092e40 going to sleep for 11 seconds 00000100:00100000:2.0:1777502233.371085:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1777502233.371186:0:186921:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837563154432 00000100:00100000:3.0:1777502233.371192:0:186921:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837563154432 00010000:00010000:3.0:1777502233.371217:0:186921:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd67665800/0x4ad31463d9bc43cd lrc: 5/0,0 mode: PR/PR res: [0x200000bd2:0x21a:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xac3ccf43bf8346a3 expref: 53 pid: 186941 timeout: 8460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777502233.371258:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1777502233.371292:0:186921:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837563154560 00000100:00100000:3.0:1777502233.371296:0:186921:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837563154560 00000100:00100000:2.0:1777502233.371345:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:3.0:1777502233.371365:0:186921:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd6b122200/0x4ad31463d9bc4413 lrc: 5/0,0 mode: PR/PR res: [0x200000bd2:0x21a:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xac3ccf43bf834672 expref: 54 pid: 186942 timeout: 8460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777502233.371387:0:186921:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837563154688 00000100:00100000:3.0:1777502233.371390:0:186921:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837563154688 00010000:00010000:3.0:1777502233.371403:0:186921:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd7226f200/0x4ad31463d9bc42bc lrc: 5/0,0 mode: PR/PR res: [0x200000bd2:0x21a:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xac3ccf43bf834633 expref: 55 pid: 186942 timeout: 8460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777502233.371412:0:186922:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1151 00000100:00100000:2.0:1777502233.371434:0:186922:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfc4a05ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0775d2ab-558e-41f1-82c0-14244d133390+55:2371:x1863837563154432:12345-192.168.202.27@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1777502233.371437:0:186921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1152 00010000:00010000:2.0:1777502233.371450:0:186922:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1777502233.371456:0:186921:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfd80180850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0775d2ab-558e-41f1-82c0-14244d133390+55:2371:x1863837563154560:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1777502233.371459:0:186922:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd67665800/0x4ad31463d9bc43cd lrc: 5/0,0 mode: PR/PR res: [0x200000bd2:0x21a:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xac3ccf43bf8346a3 expref: 55 pid: 186941 timeout: 8460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.371467:0:186921:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1777502233.371476:0:186921:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd6b122200/0x4ad31463d9bc4413 lrc: 5/0,0 mode: PR/PR res: [0x200000bd2:0x21a:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xac3ccf43bf834672 expref: 55 pid: 186942 timeout: 8460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777502233.371482:0:188208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1153 00010000:00010000:2.0:1777502233.371503:0:186922:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd67665800/0x4ad31463d9bc43cd lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x21a:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xac3ccf43bf8346a3 expref: 55 pid: 186941 timeout: 8460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777502233.371506:0:188208:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfc4a058700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0775d2ab-558e-41f1-82c0-14244d133390+55:2370:x1863837563154688:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1777502233.371522:0:186921:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd6b122200/0x4ad31463d9bc4413 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x21a:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xac3ccf43bf834672 expref: 55 pid: 186942 timeout: 8460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.371524:0:188208:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1777502233.371534:0:188208:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd7226f200/0x4ad31463d9bc42bc lrc: 5/0,0 mode: PR/PR res: [0x200000bd2:0x21a:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xac3ccf43bf834633 expref: 55 pid: 186942 timeout: 8460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.371555:0:188208:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd7226f200/0x4ad31463d9bc42bc lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x21a:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xac3ccf43bf834633 expref: 55 pid: 186942 timeout: 8460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777502233.371564:0:186922:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x21a:0x0].0x0 (ffff8dfd5b1cf600) 00010000:00010000:2.0:1777502233.371570:0:186922:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6c000/0x4ad31463d9bc494c lrc: 3/0,1 mode: --/EX res: [0x200000bd2:0x21a:0x0].0x0 bits 0x3/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 186937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777502233.371612:0:186922:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6c000/0x4ad31463d9bc494c lrc: 3/0,1 mode: --/EX res: [0x200000bd2:0x21a:0x0].0x0 bits 0x3/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 186937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.371621:0:186921:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x21a:0x0].0x0 (ffff8dfd5b1cf600) 00010000:00010000:2.0:1777502233.371621:0:186922:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1777502233.371627:0:186921:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6c000/0x4ad31463d9bc494c lrc: 3/0,1 mode: --/EX res: [0x200000bd2:0x21a:0x0].0x0 bits 0x3/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 186937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.371634:0:186921:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6c000/0x4ad31463d9bc494c lrc: 3/0,1 mode: --/EX res: [0x200000bd2:0x21a:0x0].0x0 bits 0x3/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 186937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.371641:0:186921:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1777502233.371649:0:188208:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x21a:0x0].0x0 (ffff8dfd5b1cf600) 00010000:00010000:0.0:1777502233.371654:0:188208:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6c000/0x4ad31463d9bc494c lrc: 3/0,1 mode: --/EX res: [0x200000bd2:0x21a:0x0].0x0 bits 0x3/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 186937 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777502233.371661:0:186922:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfc4a05ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0775d2ab-558e-41f1-82c0-14244d133390+55:2371:x1863837563154432:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 237us (577us total) trans 0 rc 0/0 00000100:00100000:3.0:1777502233.371668:0:186921:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfd80180850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0775d2ab-558e-41f1-82c0-14244d133390+55:2371:x1863837563154560:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 214us (410us total) trans 0 rc 0/0 00010000:00010000:0.0:1777502233.371668:0:188208:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6c000/0x4ad31463d9bc494c lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x21a:0x0].0x0 bits 0x3/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 186937 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777502233.371679:0:186922:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1151 00000100:00100000:3.0:1777502233.371688:0:186921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1152 00010000:00010000:0.0:1777502233.371698:0:188208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6c000/0x4ad31463d9bc494c lrc: 4/0,1 mode: EX/EX res: [0x200000bd2:0x21a:0x0].0x0 bits 0x3/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 186937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.371716:0:188208:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1777502233.371748:0:188208:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfc4a058700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0775d2ab-558e-41f1-82c0-14244d133390+53:2370:x1863837563154688:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 255us (404us total) trans 0 rc 0/0 00000100:00100000:0.0:1777502233.371756:0:188208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1153 00010000:00010000:0.0:1777502233.371817:0:186937:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd6b122200/0x4ad31463d9bc4413 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x21a:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xac3ccf43bf834672 expref: 52 pid: 186942 timeout: 8460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777502233.371835:0:186937:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8dfc4ddb6680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:186937:1863837561411200:192.168.202.27@tcp:104: 00010000:00010000:0.0:1777502233.371852:0:186937:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd67665800/0x4ad31463d9bc43cd lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x21a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xac3ccf43bf8346a3 expref: 51 pid: 186941 timeout: 8460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777502233.371865:0:186937:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8dfc4ddb7480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:186937:1863837561411328:192.168.202.27@tcp:104: 00010000:00010000:0.0:1777502233.371880:0:186937:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd7226f200/0x4ad31463d9bc42bc lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x21a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xac3ccf43bf834633 expref: 50 pid: 186942 timeout: 8460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777502233.371895:0:186937:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8dfc4ddb7800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:186937:1863837561411456:192.168.202.27@tcp:104: 00010000:00010000:0.0:1777502233.371923:0:186937:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6c000/0x4ad31463d9bc494c lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x21a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 186937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.371933:0:186937:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6c000/0x4ad31463d9bc494c lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x21a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 186937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.371939:0:186937:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6c000/0x4ad31463d9bc494c lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x21a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 186937 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1777502233.372687:0:186937:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].540, 64 off42752 00010000:00010000:0.0:1777502233.372777:0:186937:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6ca00/0x4ad31463d9bc4953 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x21a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 186937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.372789:0:186937:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6ca00/0x4ad31463d9bc4953 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x21a:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 186937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.372798:0:186937:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6ca00/0x4ad31463d9bc4953 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x21a:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 186937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.372804:0:186937:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6ca00/0x4ad31463d9bc4953 lrc: 4/0,1 mode: PW/PW res: [0x200000bd2:0x21a:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 186937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.372809:0:186937:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6ca00/0x4ad31463d9bc4953 lrc: 4/0,1 mode: PW/PW res: [0x200000bd2:0x21a:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 186937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.372813:0:186937:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6ca00/0x4ad31463d9bc4953 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x21a:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 186937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.372830:0:186937:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1777502233.372848:0:186937:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6c000/0x4ad31463d9bc494c lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x21a:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 186937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.372855:0:186937:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6c000/0x4ad31463d9bc494c lrc: 2/0,0 mode: EX/EX res: [0x200000bd2:0x21a:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 186937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.372862:0:186937:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6c000/0x4ad31463d9bc494c lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0x21a:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 186937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.372868:0:188362:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1777502233.372869:0:186937:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfd77e6c000 already unused, calling callback (ffffffffc1e434f0) 00010000:00010000:0.0:1777502233.372876:0:186937:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6c000/0x4ad31463d9bc494c lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0x21a:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 186937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.372877:0:188362:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6ca00/0x4ad31463d9bc4953 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x21a:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x40010480000000 pid: 186937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.372892:0:188362:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfd77e6ca00 already unused, calling callback (ffffffffc13f52e0) 00010000:00010000:0.0:1777502233.372895:0:186937:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6c000/0x4ad31463d9bc494c lrc: 4/0,0 mode: EX/EX res: [0x200000bd2:0x21a:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 186937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.372898:0:188362:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6ca00/0x4ad31463d9bc4953 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x21a:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x40010480000000 pid: 186937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.372904:0:186937:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x21a:0x0].0x0 (ffff8dfd5b1cf600) 00010000:00010000:0.0:1777502233.372907:0:186937:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1777502233.372910:0:186937:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6c000/0x4ad31463d9bc494c lrc: 2/0,0 mode: --/EX res: [0x200000bd2:0x21a:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 186937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.372913:0:188362:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6ca00/0x4ad31463d9bc4953 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x21a:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x40018480000000 pid: 186937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.372915:0:186937:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6c000/0x4ad31463d9bc494c lrc: 0/0,0 mode: --/EX res: [0x200000bd2:0x21a:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 186937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.372938:0:186937:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6dc00/0x4ad31463d9bc493e lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 186937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.372944:0:186937:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6dc00/0x4ad31463d9bc493e lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 186937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.372949:0:188362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x21a:0x0].0x0 (ffff8dfd5b1cf600) 00010000:00010000:0.0:1777502233.372949:0:186937:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6dc00/0x4ad31463d9bc493e lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 186937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.372955:0:186937:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfd77e6dc00 already unused, calling callback (ffffffffc1e434f0) 00010000:00010000:3.0:1777502233.372956:0:188362:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1777502233.372958:0:186937:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6dc00/0x4ad31463d9bc493e lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 186937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.372961:0:188362:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6ca00/0x4ad31463d9bc4953 lrc: 1/0,0 mode: --/PW res: [0x200000bd2:0x21a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 186937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.372964:0:186937:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6dc00/0x4ad31463d9bc493e lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 186937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.372972:0:186937:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffff8dfd7f712b00) 00010000:00010000:0.0:1777502233.372975:0:186937:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777502233.372976:0:188362:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6ca00/0x4ad31463d9bc4953 lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0x21a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 186937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.372978:0:186937:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6dc00/0x4ad31463d9bc493e lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 186937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.373001:0:188362:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777502233.373003:0:186937:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6dc00/0x4ad31463d9bc493e lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 186937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.373005:0:188362:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777502233.373010:0:188362:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00010000:0.0:1777502233.373020:0:186937:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000d9748bb1 reply state 000000004ba5557a transno 8589939073 ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6d200/0x4ad31463d9bc4945 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 186937 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777502233.373029:0:186937:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1777502233.373089:0:186937:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfc4a058000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4254d622-1c5a-45a0-aa2f-9afde5f83f6d+22:274351:x1863837563154304:12345-192.168.202.27@tcp:36:rm.0 Request processed in 3696us (3817us total) trans 8589939073 rc 0/0 00000100:00100000:0.0:1777502233.373098:0:186937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3829 00010000:00010000:3.0:1777502233.373723:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6d200/0x4ad31463d9bc4945 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 186937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.373732:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6d200/0x4ad31463d9bc4945 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 186937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.373739:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6d200/0x4ad31463d9bc4945 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 186937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.373745:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfd77e6d200 already unused, calling callback (ffffffffc1e434f0) 00010000:00010000:3.0:1777502233.373749:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6d200/0x4ad31463d9bc4945 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 186937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.373756:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6d200/0x4ad31463d9bc4945 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 186937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.373767:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x7516c0a8 (ffff8dfd7fc41f00) 00010000:00010000:3.0:1777502233.373770:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777502233.373774:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6d200/0x4ad31463d9bc4945 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 186937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.373787:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6d200/0x4ad31463d9bc4945 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 186937 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777502233.374151:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1777502233.374195:0:205372:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837563154816 00000100:00100000:0.0:1777502233.374202:0:205372:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837563154816 00000100:00100000:0.0:1777502233.374249:0:205372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3830 00000100:00100000:0.0:1777502233.374261:0:205372:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfc4a059f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:4254d622-1c5a-45a0-aa2f-9afde5f83f6d+21:274351:x1863837563154816:12345-192.168.202.27@tcp:101:rm.0 00010000:00010000:0.0:1777502233.374278:0:205372:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777502233.374291:0:205372:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6c800/0x4ad31463d9bc495a lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac3ccf43bf834752 expref: -99 pid: 205372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.374354:0:205372:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6d800/0x4ad31463d9bc4961 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 205372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.374366:0:205372:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6d800/0x4ad31463d9bc4961 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 205372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.374376:0:205372:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6d800/0x4ad31463d9bc4961 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 205372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.374391:0:205372:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6d600/0x4ad31463d9bc4968 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.374411:0:205372:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6d600/0x4ad31463d9bc4968 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.374419:0:205372:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6d600/0x4ad31463d9bc4968 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.374512:0:205372:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6ce00/0x4ad31463d9bc496f lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x218:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 205372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.374519:0:205372:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6ce00/0x4ad31463d9bc496f lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x218:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 205372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.374525:0:205372:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6ce00/0x4ad31463d9bc496f lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x218:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 205372 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1777502233.374548:0:205372:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd2:0x218:0x0]: returning size 0 00000004:00200000:0.0:1777502233.374551:0:205372:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1777502233.374563:0:205372:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6ce00/0x4ad31463d9bc496f lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x218:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 205372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.374570:0:205372:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6ce00/0x4ad31463d9bc496f lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x218:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 205372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.374576:0:205372:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6d800/0x4ad31463d9bc4961 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 205372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.374596:0:205372:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6d800/0x4ad31463d9bc4961 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 205372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.374601:0:205372:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6d800/0x4ad31463d9bc4961 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 205372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.374613:0:205372:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfd77e6d800 already unused, calling callback (ffffffffc1e434f0) 00010000:00010000:0.0:1777502233.374616:0:205372:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6d800/0x4ad31463d9bc4961 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 205372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.374620:0:205372:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6d800/0x4ad31463d9bc4961 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 205372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.374628:0:205372:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffff8dfd7f712b00) 00010000:00010000:0.0:1777502233.374630:0:205372:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777502233.374633:0:205372:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6d800/0x4ad31463d9bc4961 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 205372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.374638:0:205372:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6d800/0x4ad31463d9bc4961 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 205372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.374646:0:205372:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6d600/0x4ad31463d9bc4968 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.374651:0:205372:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6d600/0x4ad31463d9bc4968 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 205372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.374655:0:205372:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6d600/0x4ad31463d9bc4968 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.374658:0:205372:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfd77e6d600 already unused, calling callback (ffffffffc1e434f0) 00010000:00010000:0.0:1777502233.374661:0:205372:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6d600/0x4ad31463d9bc4968 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.374665:0:205372:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6d600/0x4ad31463d9bc4968 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 205372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.374677:0:205372:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0xef18c0a8 (ffff8dfd7fc41a00) 00010000:00010000:0.0:1777502233.374679:0:205372:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777502233.374681:0:205372:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6d600/0x4ad31463d9bc4968 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.374685:0:205372:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6d600/0x4ad31463d9bc4968 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.374712:0:205372:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6c800/0x4ad31463d9bc495a lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xac3ccf43bf834752 expref: 23 pid: 205372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.374727:0:205372:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6ce00/0x4ad31463d9bc496f lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x218:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xac3ccf43bf834752 expref: 22 pid: 205372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.374735:0:205372:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x218:0x0].0x0 (ffff8dfd58bbe500) 00010000:00010000:0.0:1777502233.374738:0:205372:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1777502233.374741:0:205372:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dfd77e6ce00, rc 0) 00000100:00100000:0.0:1777502233.374781:0:205372:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfc4a059f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:4254d622-1c5a-45a0-aa2f-9afde5f83f6d+22:274351:x1863837563154816:12345-192.168.202.27@tcp:101:rm.0 Request processed in 524us (631us total) trans 0 rc 0/0 00000100:00100000:0.0:1777502233.374790:0:205372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3830 00000100:00100000:2.0:1777502233.375948:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1777502233.376066:0:205369:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837563155072 00000100:00100000:3.0:1777502233.376071:0:205369:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837563155072 00000100:00100000:3.0:1777502233.376116:0:205369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3831 00000100:00100000:3.0:1777502233.376127:0:205369:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfc4a058e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:4254d622-1c5a-45a0-aa2f-9afde5f83f6d+22:274351:x1863837563155072:12345-192.168.202.27@tcp:36:rm.0 00010000:00010000:3.0:1777502233.376164:0:205369:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1777502233.376182:0:205369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6ce00/0x4ad31463d9bc496f lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x218:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xac3ccf43bf834752 expref: 22 pid: 205372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.376197:0:205369:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x218:0x0].0x0 (ffff8dfd58bbe500) 00010000:00010000:3.0:1777502233.376200:0:205369:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1777502233.376213:0:205369:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da56600/0x4ad31463d9bc4976 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 205369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.376221:0:205369:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da56600/0x4ad31463d9bc4976 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 205369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.376227:0:205369:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da56600/0x4ad31463d9bc4976 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 205369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.376236:0:205369:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da56200/0x4ad31463d9bc497d lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.376241:0:205369:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da56200/0x4ad31463d9bc497d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.376247:0:205369:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da56200/0x4ad31463d9bc497d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.376354:0:205369:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da57800/0x4ad31463d9bc4984 lrc: 3/0,1 mode: --/EX res: [0x200000bd2:0x218:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 205369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.376442:0:205369:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd45703e00/0x4ad31463d9bc4253 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x218:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xac3ccf43bf834625 expref: 49 pid: 186942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.376452:0:205369:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd67664c00/0x4ad31463d9bc4348 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x218:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xac3ccf43bf834695 expref: 49 pid: 186941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.376461:0:205369:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd505efa00/0x4ad31463d9bc43a3 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x218:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xac3ccf43bf834664 expref: 49 pid: 186942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.376468:0:205369:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da57800/0x4ad31463d9bc4984 lrc: 6/0,1 mode: --/EX res: [0x200000bd2:0x218:0x0].0x0 bits 0x3/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 205369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.376513:0:205369:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd505efa00/0x4ad31463d9bc43a3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x218:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xac3ccf43bf834664 expref: 49 pid: 186942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.376528:0:205369:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd505efa00/0x4ad31463d9bc43a3 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x218:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xac3ccf43bf834664 expref: 49 pid: 186942 timeout: 8460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777502233.376543:0:205369:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8dfd7c2fd500 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:205369:1863837561411584:192.168.202.27@tcp:104: 00010000:00010000:3.0:1777502233.376661:0:205369:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd67664c00/0x4ad31463d9bc4348 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x218:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xac3ccf43bf834695 expref: 49 pid: 186941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.376672:0:205369:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd67664c00/0x4ad31463d9bc4348 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x218:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xac3ccf43bf834695 expref: 49 pid: 186941 timeout: 8460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777502233.376694:0:205369:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8dfd7c2ffb80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:205369:1863837561411712:192.168.202.27@tcp:104: 00010000:00010000:3.0:1777502233.376743:0:205369:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd45703e00/0x4ad31463d9bc4253 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x218:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xac3ccf43bf834625 expref: 49 pid: 186942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.376753:0:205369:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd45703e00/0x4ad31463d9bc4253 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x218:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xac3ccf43bf834625 expref: 49 pid: 186942 timeout: 8460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777502233.376764:0:205369:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8dfd7c2ff100 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:205369:1863837561411840:192.168.202.27@tcp:104: 00000100:00100000:3.0:1777502233.376870:0:205369:0:(client.c:2691:ptlrpc_set_wait()) set ffff8dfc45a25cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1777502233.378292:0:205369:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8dfd7c2fd500 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:205369:1863837561411584:192.168.202.27@tcp:104: 00000100:00100000:3.0:1777502233.378312:0:205369:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8dfd7c2ffb80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:205369:1863837561411712:192.168.202.27@tcp:104: 00000100:00100000:2.0:1777502233.378370:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1777502233.378424:0:205389:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837563155328 00000100:00100000:3.0:1777502233.378430:0:205389:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837563155328 00000100:00100000:2.0:1777502233.378444:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:3.0:1777502233.378462:0:205389:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd67664c00/0x4ad31463d9bc4348 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x218:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xac3ccf43bf834695 expref: 50 pid: 186941 timeout: 8460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777502233.378501:0:205388:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837563155200 00000100:00100000:0.0:1777502233.378507:0:205388:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837563155200 00010000:00010000:0.0:1777502233.378535:0:205388:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd505efa00/0x4ad31463d9bc43a3 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x218:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xac3ccf43bf834664 expref: 51 pid: 186942 timeout: 8460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777502233.378541:0:186922:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1154 00000100:00100000:2.0:1777502233.378558:0:186922:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfc4a059c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0775d2ab-558e-41f1-82c0-14244d133390+51:2370:x1863837563155328:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1777502233.378572:0:186922:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1777502233.378594:0:205388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1155 00000100:00100000:0.0:1777502233.378605:0:205388:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfc4a05a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:0775d2ab-558e-41f1-82c0-14244d133390+51:2371:x1863837563155200:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1777502233.378616:0:186922:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd67664c00/0x4ad31463d9bc4348 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x218:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xac3ccf43bf834695 expref: 51 pid: 186941 timeout: 8460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.378629:0:205388:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1777502233.378634:0:186922:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd67664c00/0x4ad31463d9bc4348 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x218:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xac3ccf43bf834695 expref: 51 pid: 186941 timeout: 8460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.378639:0:205388:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd505efa00/0x4ad31463d9bc43a3 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x218:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xac3ccf43bf834664 expref: 51 pid: 186942 timeout: 8460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.378669:0:205388:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd505efa00/0x4ad31463d9bc43a3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x218:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xac3ccf43bf834664 expref: 51 pid: 186942 timeout: 8460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777502233.378694:0:186922:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd67664c00/0x4ad31463d9bc4348 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x218:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xac3ccf43bf834695 expref: 51 pid: 186941 timeout: 8460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.378701:0:205388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd505efa00/0x4ad31463d9bc43a3 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x218:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xac3ccf43bf834664 expref: 51 pid: 186942 timeout: 8460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777502233.378715:0:186922:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x218:0x0].0x0 (ffff8dfd58bbe500) 00010000:00010000:2.0:1777502233.378722:0:186922:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da57800/0x4ad31463d9bc4984 lrc: 3/0,1 mode: --/EX res: [0x200000bd2:0x218:0x0].0x0 bits 0x3/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 205369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777502233.378731:0:186922:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da57800/0x4ad31463d9bc4984 lrc: 3/0,1 mode: --/EX res: [0x200000bd2:0x218:0x0].0x0 bits 0x3/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 205369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777502233.378738:0:186922:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1777502233.378739:0:205388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x218:0x0].0x0 (ffff8dfd58bbe500) 00010000:00010000:0.0:1777502233.378744:0:205388:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da57800/0x4ad31463d9bc4984 lrc: 3/0,1 mode: --/EX res: [0x200000bd2:0x218:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 205369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.378752:0:205388:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da57800/0x4ad31463d9bc4984 lrc: 3/0,1 mode: --/EX res: [0x200000bd2:0x218:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 205369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.378758:0:205388:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1777502233.378772:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1777502233.378778:0:186922:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfc4a059c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0775d2ab-558e-41f1-82c0-14244d133390+49:2370:x1863837563155328:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 224us (409us total) trans 0 rc 0/0 00000100:00100000:2.0:1777502233.378788:0:186922:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1154 00000100:00100000:0.0:1777502233.378788:0:205388:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfc4a05a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:0775d2ab-558e-41f1-82c0-14244d133390+49:2371:x1863837563155200:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 183us (344us total) trans 0 rc 0/0 00000100:00100000:0.0:1777502233.378808:0:205388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1155 00000100:00100000:2.0:1777502233.378815:0:186922:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837563155456 00000100:00100000:2.0:1777502233.378820:0:186922:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837563155456 00010000:00010000:2.0:1777502233.378840:0:186922:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd45703e00/0x4ad31463d9bc4253 lrc: 5/0,0 mode: PR/PR res: [0x200000bd2:0x218:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xac3ccf43bf834625 expref: 48 pid: 186942 timeout: 8460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777502233.378877:0:191872:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1156 00000100:00100000:3.0:1777502233.378888:0:191872:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfd7c2fe300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0775d2ab-558e-41f1-82c0-14244d133390+48:2371:x1863837563155456:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1777502233.378898:0:191872:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1777502233.378905:0:191872:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd45703e00/0x4ad31463d9bc4253 lrc: 5/0,0 mode: PR/PR res: [0x200000bd2:0x218:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xac3ccf43bf834625 expref: 48 pid: 186942 timeout: 8460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.379053:0:191872:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd45703e00/0x4ad31463d9bc4253 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x218:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xac3ccf43bf834625 expref: 48 pid: 186942 timeout: 8460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.379068:0:191872:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x218:0x0].0x0 (ffff8dfd58bbe500) 00010000:00010000:3.0:1777502233.379073:0:191872:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da57800/0x4ad31463d9bc4984 lrc: 3/0,1 mode: --/EX res: [0x200000bd2:0x218:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 205369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.379080:0:191872:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da57800/0x4ad31463d9bc4984 lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x218:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 205369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.379088:0:191872:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da57800/0x4ad31463d9bc4984 lrc: 4/0,1 mode: EX/EX res: [0x200000bd2:0x218:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 205369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.379105:0:191872:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1777502233.379135:0:191872:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfd7c2fe300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0775d2ab-558e-41f1-82c0-14244d133390+48:2371:x1863837563155456:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 249us (365us total) trans 0 rc 0/0 00000100:00100000:3.0:1777502233.379144:0:191872:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1156 00010000:00010000:3.0:1777502233.379186:0:205369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd45703e00/0x4ad31463d9bc4253 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x218:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xac3ccf43bf834625 expref: 47 pid: 186942 timeout: 8460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777502233.379210:0:205369:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8dfd7c2ff100 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:205369:1863837561411840:192.168.202.27@tcp:104: 00010000:00010000:3.0:1777502233.379244:0:205369:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da57800/0x4ad31463d9bc4984 lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x218:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 205369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.379305:0:205369:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da57800/0x4ad31463d9bc4984 lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x218:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 205369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.379310:0:205369:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da57800/0x4ad31463d9bc4984 lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x218:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 205369 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1777502233.380071:0:205369:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].541, 64 off42816 00010000:00010000:3.0:1777502233.380142:0:205369:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da56c00/0x4ad31463d9bc498b lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x218:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 205369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.380153:0:205369:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da56c00/0x4ad31463d9bc498b lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x218:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 205369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.380162:0:205369:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da56c00/0x4ad31463d9bc498b lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x218:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 205369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.380170:0:205369:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da56c00/0x4ad31463d9bc498b lrc: 4/0,1 mode: PW/PW res: [0x200000bd2:0x218:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 205369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.380176:0:205369:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da56c00/0x4ad31463d9bc498b lrc: 4/0,1 mode: PW/PW res: [0x200000bd2:0x218:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 205369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.380182:0:205369:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da56c00/0x4ad31463d9bc498b lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x218:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 205369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.380199:0:205369:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1777502233.380217:0:205369:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da57800/0x4ad31463d9bc4984 lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x218:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 205369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.380223:0:205369:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da57800/0x4ad31463d9bc4984 lrc: 2/0,0 mode: EX/EX res: [0x200000bd2:0x218:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 205369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777502233.380230:0:186924:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1777502233.380231:0:205369:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da57800/0x4ad31463d9bc4984 lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0x218:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 205369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.380239:0:205369:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfd4da57800 already unused, calling callback (ffffffffc1e434f0) 00010000:00010000:2.0:1777502233.380239:0:186924:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da56c00/0x4ad31463d9bc498b lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x218:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x40010480000000 pid: 205369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.380247:0:205369:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da57800/0x4ad31463d9bc4984 lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0x218:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 205369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777502233.380250:0:186924:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfd4da56c00 already unused, calling callback (ffffffffc13f52e0) 00010000:00010000:2.0:1777502233.380255:0:186924:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da56c00/0x4ad31463d9bc498b lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x218:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x40010480000000 pid: 205369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.380263:0:205369:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da57800/0x4ad31463d9bc4984 lrc: 4/0,0 mode: EX/EX res: [0x200000bd2:0x218:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 205369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777502233.380267:0:186924:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da56c00/0x4ad31463d9bc498b lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x218:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x40018480000000 pid: 205369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.380274:0:205369:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x218:0x0].0x0 (ffff8dfd58bbe500) 00010000:00010000:3.0:1777502233.380281:0:205369:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1777502233.380286:0:205369:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da57800/0x4ad31463d9bc4984 lrc: 2/0,0 mode: --/EX res: [0x200000bd2:0x218:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 205369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777502233.380293:0:186924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x218:0x0].0x0 (ffff8dfd58bbe500) 00010000:00010000:3.0:1777502233.380294:0:205369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da57800/0x4ad31463d9bc4984 lrc: 0/0,0 mode: --/EX res: [0x200000bd2:0x218:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 205369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777502233.380299:0:186924:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1777502233.380305:0:186924:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da56c00/0x4ad31463d9bc498b lrc: 1/0,0 mode: --/PW res: [0x200000bd2:0x218:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x44819480000000 pid: 205369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777502233.380313:0:186924:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da56c00/0x4ad31463d9bc498b lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0x218:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 205369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.380319:0:205369:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da56600/0x4ad31463d9bc4976 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 205369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.380327:0:205369:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da56600/0x4ad31463d9bc4976 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 205369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777502233.380328:0:186924:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777502233.380333:0:186924:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777502233.380335:0:205369:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da56600/0x4ad31463d9bc4976 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 205369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777502233.380337:0:186924:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777502233.380340:0:205369:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfd4da56600 already unused, calling callback (ffffffffc1e434f0) 00010000:00010000:3.0:1777502233.380344:0:205369:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da56600/0x4ad31463d9bc4976 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 205369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.380348:0:205369:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da56600/0x4ad31463d9bc4976 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 205369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.380356:0:205369:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffff8dfd7f712b00) 00010000:00010000:3.0:1777502233.380358:0:205369:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777502233.380362:0:205369:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da56600/0x4ad31463d9bc4976 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 205369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.380383:0:205369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da56600/0x4ad31463d9bc4976 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 205369 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1777502233.380397:0:205369:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000005223d7c6 reply state 00000000336f082c transno 8589939074 ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da56200/0x4ad31463d9bc497d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205369 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777502233.380405:0:205369:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1777502233.380460:0:205369:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfc4a058e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:4254d622-1c5a-45a0-aa2f-9afde5f83f6d+23:274351:x1863837563155072:12345-192.168.202.27@tcp:36:rm.0 Request processed in 4335us (4514us total) trans 8589939074 rc 0/0 00000100:00100000:3.0:1777502233.380466:0:205369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3831 00010000:00010000:3.0:1777502233.381312:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da56200/0x4ad31463d9bc497d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.381319:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da56200/0x4ad31463d9bc497d lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 205369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.381323:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da56200/0x4ad31463d9bc497d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.381328:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfd4da56200 already unused, calling callback (ffffffffc1e434f0) 00010000:00010000:3.0:1777502233.381332:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da56200/0x4ad31463d9bc497d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.381339:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da56200/0x4ad31463d9bc497d lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 205369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.381350:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0xef18c0a8 (ffff8dfd47d8b700) 00010000:00010000:3.0:1777502233.381353:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777502233.381357:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da56200/0x4ad31463d9bc497d lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.381374:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da56200/0x4ad31463d9bc497d lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205369 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777502233.381631:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1777502233.381706:0:186936:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837563155584 00000100:00100000:3.0:1777502233.381713:0:186936:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837563155584 00000100:00100000:3.0:1777502233.381756:0:186936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3832 00000100:00100000:3.0:1777502233.381767:0:186936:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfc4a05b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4254d622-1c5a-45a0-aa2f-9afde5f83f6d+22:274351:x1863837563155584:12345-192.168.202.27@tcp:101:rm.0 00010000:00010000:3.0:1777502233.381786:0:186936:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777502233.381799:0:186936:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da57c00/0x4ad31463d9bc4992 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac3ccf43bf834759 expref: -99 pid: 186936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.381846:0:186936:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da57400/0x4ad31463d9bc4999 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 186936 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.381855:0:186936:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da57400/0x4ad31463d9bc4999 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 186936 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.381864:0:186936:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da57400/0x4ad31463d9bc4999 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 186936 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.381879:0:186936:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da57a00/0x4ad31463d9bc49a0 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 186936 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.381887:0:186936:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da57a00/0x4ad31463d9bc49a0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 186936 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.381895:0:186936:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da57a00/0x4ad31463d9bc49a0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 186936 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.381979:0:186936:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da56000/0x4ad31463d9bc49a7 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x20f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 186936 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.381994:0:186936:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da56000/0x4ad31463d9bc49a7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x20f:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 186936 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.382003:0:186936:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da56000/0x4ad31463d9bc49a7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x20f:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 186936 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1777502233.382037:0:186936:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd2:0x20f:0x0]: returning size 0 00000004:00200000:3.0:1777502233.382042:0:186936:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1777502233.382057:0:186936:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da56000/0x4ad31463d9bc49a7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x20f:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 186936 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.382069:0:186936:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da56000/0x4ad31463d9bc49a7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x20f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 186936 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.382077:0:186936:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da57400/0x4ad31463d9bc4999 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 186936 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.382083:0:186936:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da57400/0x4ad31463d9bc4999 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 186936 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.382089:0:186936:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da57400/0x4ad31463d9bc4999 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 186936 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.382095:0:186936:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfd4da57400 already unused, calling callback (ffffffffc1e434f0) 00010000:00010000:3.0:1777502233.382099:0:186936:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da57400/0x4ad31463d9bc4999 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 186936 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.382107:0:186936:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da57400/0x4ad31463d9bc4999 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 186936 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.382117:0:186936:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffff8dfd7f712b00) 00010000:00010000:3.0:1777502233.382125:0:186936:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777502233.382130:0:186936:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da57400/0x4ad31463d9bc4999 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 186936 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.382136:0:186936:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da57400/0x4ad31463d9bc4999 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 186936 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.382149:0:186936:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da57a00/0x4ad31463d9bc49a0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 186936 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.382155:0:186936:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da57a00/0x4ad31463d9bc49a0 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 186936 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.382161:0:186936:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da57a00/0x4ad31463d9bc49a0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 186936 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.382167:0:186936:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfd4da57a00 already unused, calling callback (ffffffffc1e434f0) 00010000:00010000:3.0:1777502233.382171:0:186936:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da57a00/0x4ad31463d9bc49a0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 186936 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.382177:0:186936:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da57a00/0x4ad31463d9bc49a0 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 186936 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.382188:0:186936:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0xed314fa8 (ffff8dfd47d8ba00) 00010000:00010000:3.0:1777502233.382192:0:186936:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777502233.382195:0:186936:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da57a00/0x4ad31463d9bc49a0 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 186936 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.382201:0:186936:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da57a00/0x4ad31463d9bc49a0 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 186936 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.382235:0:186936:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da57c00/0x4ad31463d9bc4992 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xac3ccf43bf834759 expref: 24 pid: 186936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.382261:0:186936:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da56000/0x4ad31463d9bc49a7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x20f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xac3ccf43bf834759 expref: 23 pid: 186936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.382269:0:186936:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x20f:0x0].0x0 (ffff8dfd5b1cf500) 00010000:00010000:3.0:1777502233.382272:0:186936:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1777502233.382276:0:186936:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dfd4da56000, rc 0) 00000100:00100000:3.0:1777502233.382319:0:186936:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfc4a05b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4254d622-1c5a-45a0-aa2f-9afde5f83f6d+23:274351:x1863837563155584:12345-192.168.202.27@tcp:101:rm.0 Request processed in 553us (689us total) trans 0 rc 0/0 00000100:00100000:3.0:1777502233.382328:0:186936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3832 00000100:00100000:0.0:1777502233.383459:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1777502233.383515:0:188648:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837563155840 00000100:00100000:2.0:1777502233.383521:0:188648:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837563155840 00000100:00100000:2.0:1777502233.383561:0:188648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3833 00000100:00100000:2.0:1777502233.383572:0:188648:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfc4ddb7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4254d622-1c5a-45a0-aa2f-9afde5f83f6d+23:274351:x1863837563155840:12345-192.168.202.27@tcp:36:rm.0 00010000:00010000:2.0:1777502233.383629:0:188648:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1777502233.383651:0:188648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da56000/0x4ad31463d9bc49a7 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x20f:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xac3ccf43bf834759 expref: 23 pid: 186936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777502233.383667:0:188648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x20f:0x0].0x0 (ffff8dfd5b1cf500) 00010000:00010000:2.0:1777502233.383672:0:188648:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1777502233.383687:0:188648:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd7eec8200/0x4ad31463d9bc49ae lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 188648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777502233.383694:0:188648:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd7eec8200/0x4ad31463d9bc49ae lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 188648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777502233.383701:0:188648:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd7eec8200/0x4ad31463d9bc49ae lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 188648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777502233.383723:0:188648:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd7eec9600/0x4ad31463d9bc49b5 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777502233.383731:0:188648:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd7eec9600/0x4ad31463d9bc49b5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777502233.383740:0:188648:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd7eec9600/0x4ad31463d9bc49b5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777502233.383838:0:188648:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd7eec8400/0x4ad31463d9bc49bc lrc: 3/0,1 mode: --/EX res: [0x200000bd2:0x20f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 188648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777502233.383850:0:188648:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd58a73400/0x4ad31463d9bc3fc1 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x20f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xac3ccf43bf834522 expref: 46 pid: 186937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777502233.383858:0:188648:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd7eec8400/0x4ad31463d9bc49bc lrc: 4/0,1 mode: --/EX res: [0x200000bd2:0x20f:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777502233.383887:0:188648:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd58a73400/0x4ad31463d9bc3fc1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x20f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xac3ccf43bf834522 expref: 46 pid: 186937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777502233.383901:0:188648:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd58a73400/0x4ad31463d9bc3fc1 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x20f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xac3ccf43bf834522 expref: 46 pid: 186937 timeout: 8460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777502233.383916:0:188648:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8dfc4a05ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:188648:1863837561411968:192.168.202.27@tcp:104: 00000100:00100000:2.0:1777502233.383987:0:188648:0:(client.c:2691:ptlrpc_set_wait()) set ffff8dfd51ffa0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1777502233.384812:0:188648:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8dfc4a05ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:188648:1863837561411968:192.168.202.27@tcp:104: 00010000:00010000:0.0:1777502233.384837:0:188648:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd7eec8400/0x4ad31463d9bc49bc lrc: 3/0,1 mode: --/EX res: [0x200000bd2:0x20f:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 188648 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777502233.385031:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1777502233.385075:0:188208:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837563155968 00000100:00100000:2.0:1777502233.385082:0:188208:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837563155968 00010000:00010000:2.0:1777502233.385113:0:188208:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd58a73400/0x4ad31463d9bc3fc1 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x20f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xac3ccf43bf834522 expref: 47 pid: 186937 timeout: 8460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777502233.385145:0:188208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1157 00000100:00100000:2.0:1777502233.385154:0:188208:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfc4ddb7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0775d2ab-558e-41f1-82c0-14244d133390+47:2370:x1863837563155968:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1777502233.385163:0:188208:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1777502233.385168:0:188208:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd58a73400/0x4ad31463d9bc3fc1 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x20f:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xac3ccf43bf834522 expref: 47 pid: 186937 timeout: 8460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777502233.385182:0:188208:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd58a73400/0x4ad31463d9bc3fc1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x20f:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xac3ccf43bf834522 expref: 47 pid: 186937 timeout: 8460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777502233.385200:0:188208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd58a73400/0x4ad31463d9bc3fc1 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x20f:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xac3ccf43bf834522 expref: 47 pid: 186937 timeout: 8460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777502233.385213:0:188208:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x20f:0x0].0x0 (ffff8dfd5b1cf500) 00010000:00010000:2.0:1777502233.385218:0:188208:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd7eec8400/0x4ad31463d9bc49bc lrc: 3/0,1 mode: --/EX res: [0x200000bd2:0x20f:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 188648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777502233.385227:0:188208:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd7eec8400/0x4ad31463d9bc49bc lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x20f:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 188648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777502233.385234:0:188208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd7eec8400/0x4ad31463d9bc49bc lrc: 4/0,1 mode: EX/EX res: [0x200000bd2:0x20f:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 188648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777502233.385254:0:188208:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1777502233.385287:0:188208:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfc4ddb7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0775d2ab-558e-41f1-82c0-14244d133390+46:2370:x1863837563155968:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 133us (255us total) trans 0 rc 0/0 00010000:00010000:0.0:1777502233.385293:0:188648:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd7eec8400/0x4ad31463d9bc49bc lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x20f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188648 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777502233.385296:0:188208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1157 00010000:00010000:0.0:1777502233.385313:0:188648:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd7eec8400/0x4ad31463d9bc49bc lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x20f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188648 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1777502233.386057:0:188648:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].537, 64 off42560 00010000:00010000:0.0:1777502233.386162:0:188648:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6c800/0x4ad31463d9bc49c3 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x20f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 188648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.386173:0:188648:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6c800/0x4ad31463d9bc49c3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x20f:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 188648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.386185:0:188648:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6c800/0x4ad31463d9bc49c3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x20f:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 188648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.386202:0:188648:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6c800/0x4ad31463d9bc49c3 lrc: 4/0,1 mode: PW/PW res: [0x200000bd2:0x20f:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 188648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.386210:0:188648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6c800/0x4ad31463d9bc49c3 lrc: 4/0,1 mode: PW/PW res: [0x200000bd2:0x20f:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 188648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.386217:0:188648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6c800/0x4ad31463d9bc49c3 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x20f:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 188648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.386239:0:188648:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1777502233.386255:0:188648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd7eec8400/0x4ad31463d9bc49bc lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x20f:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.386260:0:188648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd7eec8400/0x4ad31463d9bc49bc lrc: 2/0,0 mode: EX/EX res: [0x200000bd2:0x20f:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 188648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.386265:0:188648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd7eec8400/0x4ad31463d9bc49bc lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0x20f:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 188648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.386266:0:186925:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1777502233.386275:0:186925:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6c800/0x4ad31463d9bc49c3 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x20f:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x40010480000000 pid: 188648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.386278:0:188648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfd7eec8400 already unused, calling callback (ffffffffc1e434f0) 00010000:00010000:0.0:1777502233.386284:0:188648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd7eec8400/0x4ad31463d9bc49bc lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0x20f:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 188648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.386290:0:186925:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfd77e6c800 already unused, calling callback (ffffffffc13f52e0) 00010000:00010000:0.0:1777502233.386292:0:188648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd7eec8400/0x4ad31463d9bc49bc lrc: 4/0,0 mode: EX/EX res: [0x200000bd2:0x20f:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 188648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.386296:0:186925:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6c800/0x4ad31463d9bc49c3 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x20f:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x40010480000000 pid: 188648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.386302:0:188648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x20f:0x0].0x0 (ffff8dfd5b1cf500) 00010000:00010000:0.0:1777502233.386305:0:188648:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1777502233.386309:0:188648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd7eec8400/0x4ad31463d9bc49bc lrc: 2/0,0 mode: --/EX res: [0x200000bd2:0x20f:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 188648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.386312:0:186925:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6c800/0x4ad31463d9bc49c3 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x20f:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x40018480000000 pid: 188648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.386315:0:188648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd7eec8400/0x4ad31463d9bc49bc lrc: 0/0,0 mode: --/EX res: [0x200000bd2:0x20f:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 188648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.386336:0:186925:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x20f:0x0].0x0 (ffff8dfd5b1cf500) 00010000:00010000:3.0:1777502233.386341:0:186925:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1777502233.386343:0:188648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd7eec8200/0x4ad31463d9bc49ae lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 188648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.386345:0:186925:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6c800/0x4ad31463d9bc49c3 lrc: 1/0,0 mode: --/PW res: [0x200000bd2:0x20f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 188648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.386363:0:188648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd7eec8200/0x4ad31463d9bc49ae lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 188648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.386364:0:186925:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6c800/0x4ad31463d9bc49c3 lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0x20f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 188648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.386383:0:188648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd7eec8200/0x4ad31463d9bc49ae lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 188648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.386402:0:188648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfd7eec8200 already unused, calling callback (ffffffffc1e434f0) 00010000:00010000:0.0:1777502233.386406:0:188648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd7eec8200/0x4ad31463d9bc49ae lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 188648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.386407:0:186925:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777502233.386412:0:186925:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777502233.386414:0:188648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd7eec8200/0x4ad31463d9bc49ae lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 188648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.386416:0:186925:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777502233.386432:0:188648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffff8dfd7f712b00) 00010000:00010000:0.0:1777502233.386434:0:188648:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777502233.386437:0:188648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd7eec8200/0x4ad31463d9bc49ae lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 188648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.386442:0:188648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd7eec8200/0x4ad31463d9bc49ae lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 188648 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1777502233.386451:0:188648:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000bb177170 reply state 00000000d94f817b transno 8589939075 ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd7eec9600/0x4ad31463d9bc49b5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188648 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777502233.386457:0:188648:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1777502233.386527:0:188648:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfc4ddb7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4254d622-1c5a-45a0-aa2f-9afde5f83f6d+24:274351:x1863837563155840:12345-192.168.202.27@tcp:36:rm.0 Request processed in 2956us (3071us total) trans 8589939075 rc 0/0 00000100:00100000:0.0:1777502233.386536:0:188648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3833 00010000:00010000:3.0:1777502233.387300:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd7eec9600/0x4ad31463d9bc49b5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.387312:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd7eec9600/0x4ad31463d9bc49b5 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.387320:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd7eec9600/0x4ad31463d9bc49b5 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.387326:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfd7eec9600 already unused, calling callback (ffffffffc1e434f0) 00010000:00010000:3.0:1777502233.387330:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd7eec9600/0x4ad31463d9bc49b5 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.387338:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd7eec9600/0x4ad31463d9bc49b5 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.387350:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0xed314fa8 (ffff8dfd80102000) 00010000:00010000:3.0:1777502233.387353:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777502233.387357:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd7eec9600/0x4ad31463d9bc49b5 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.387364:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd7eec9600/0x4ad31463d9bc49b5 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188648 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777502233.387715:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1777502233.387769:0:187571:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837563156096 00000100:00100000:0.0:1777502233.387776:0:187571:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837563156096 00000100:00100000:0.0:1777502233.387818:0:187571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3834 00000100:00100000:0.0:1777502233.387828:0:187571:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfc4a05ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4254d622-1c5a-45a0-aa2f-9afde5f83f6d+23:274351:x1863837563156096:12345-192.168.202.27@tcp:101:rm.0 00010000:00010000:0.0:1777502233.387845:0:187571:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777502233.387859:0:187571:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6d600/0x4ad31463d9bc49ca lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac3ccf43bf834760 expref: -99 pid: 187571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.387908:0:187571:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6d800/0x4ad31463d9bc49d1 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 187571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.387918:0:187571:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6d800/0x4ad31463d9bc49d1 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 187571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.387940:0:187571:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6d800/0x4ad31463d9bc49d1 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 187571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.387954:0:187571:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6dc00/0x4ad31463d9bc49d8 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.387963:0:187571:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6dc00/0x4ad31463d9bc49d8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.387971:0:187571:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6dc00/0x4ad31463d9bc49d8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.388072:0:187571:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6c000/0x4ad31463d9bc49df lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x215:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 187571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.388083:0:187571:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6c000/0x4ad31463d9bc49df lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x215:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.388092:0:187571:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6c000/0x4ad31463d9bc49df lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x215:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 187571 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1777502233.388118:0:187571:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd2:0x215:0x0]: returning size 0 00000004:00200000:0.0:1777502233.388135:0:187571:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1777502233.388152:0:187571:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6c000/0x4ad31463d9bc49df lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x215:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 187571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.388164:0:187571:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6c000/0x4ad31463d9bc49df lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x215:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.388173:0:187571:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6d800/0x4ad31463d9bc49d1 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 187571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.388189:0:187571:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6d800/0x4ad31463d9bc49d1 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 187571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.388196:0:187571:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6d800/0x4ad31463d9bc49d1 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 187571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.388202:0:187571:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfd77e6d800 already unused, calling callback (ffffffffc1e434f0) 00010000:00010000:0.0:1777502233.388206:0:187571:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6d800/0x4ad31463d9bc49d1 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 187571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.388214:0:187571:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6d800/0x4ad31463d9bc49d1 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 187571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.388225:0:187571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffff8dfd7f712b00) 00010000:00010000:0.0:1777502233.388229:0:187571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777502233.388232:0:187571:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6d800/0x4ad31463d9bc49d1 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 187571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.388239:0:187571:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6d800/0x4ad31463d9bc49d1 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 187571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.388251:0:187571:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6dc00/0x4ad31463d9bc49d8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.388258:0:187571:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6dc00/0x4ad31463d9bc49d8 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.388265:0:187571:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6dc00/0x4ad31463d9bc49d8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.388271:0:187571:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfd77e6dc00 already unused, calling callback (ffffffffc1e434f0) 00010000:00010000:0.0:1777502233.388280:0:187571:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6dc00/0x4ad31463d9bc49d8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.388287:0:187571:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6dc00/0x4ad31463d9bc49d8 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.388297:0:187571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x858dc0a8 (ffff8dfd7fc41a00) 00010000:00010000:0.0:1777502233.388306:0:187571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777502233.388309:0:187571:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6dc00/0x4ad31463d9bc49d8 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.388316:0:187571:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6dc00/0x4ad31463d9bc49d8 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.388350:0:187571:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6d600/0x4ad31463d9bc49ca lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xac3ccf43bf834760 expref: 25 pid: 187571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.388364:0:187571:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6c000/0x4ad31463d9bc49df lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x215:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xac3ccf43bf834760 expref: 24 pid: 187571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.388372:0:187571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x215:0x0].0x0 (ffff8dfd5b1cf000) 00010000:00010000:0.0:1777502233.388375:0:187571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1777502233.388378:0:187571:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dfd77e6c000, rc 0) 00000100:00100000:0.0:1777502233.388425:0:187571:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfc4a05ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4254d622-1c5a-45a0-aa2f-9afde5f83f6d+24:274351:x1863837563156096:12345-192.168.202.27@tcp:101:rm.0 Request processed in 597us (713us total) trans 0 rc 0/0 00000100:00100000:0.0:1777502233.388434:0:187571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3834 00000100:00100000:0.0:1777502233.389841:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1777502233.389897:0:186937:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837563156352 00000100:00100000:2.0:1777502233.389904:0:186937:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837563156352 00000100:00100000:2.0:1777502233.389950:0:186937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3835 00000100:00100000:2.0:1777502233.389960:0:186937:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfc4ddb6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4254d622-1c5a-45a0-aa2f-9afde5f83f6d+24:274351:x1863837563156352:12345-192.168.202.27@tcp:36:rm.0 00010000:00010000:2.0:1777502233.390000:0:186937:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1777502233.390020:0:186937:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6c000/0x4ad31463d9bc49df lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x215:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xac3ccf43bf834760 expref: 24 pid: 187571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777502233.390036:0:186937:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x215:0x0].0x0 (ffff8dfd5b1cf000) 00010000:00010000:2.0:1777502233.390041:0:186937:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1777502233.390057:0:186937:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd7eec9400/0x4ad31463d9bc49e6 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 186937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777502233.390067:0:186937:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd7eec9400/0x4ad31463d9bc49e6 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 186937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777502233.390077:0:186937:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd7eec9400/0x4ad31463d9bc49e6 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 186937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777502233.390092:0:186937:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd7eec8600/0x4ad31463d9bc49ed lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 186937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777502233.390100:0:186937:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd7eec8600/0x4ad31463d9bc49ed lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 186937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777502233.390107:0:186937:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd7eec8600/0x4ad31463d9bc49ed lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 186937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777502233.390213:0:186937:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd7eec9a00/0x4ad31463d9bc49f4 lrc: 3/0,1 mode: --/EX res: [0x200000bd2:0x215:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 186937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777502233.390242:0:186937:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd43979e00/0x4ad31463d9bc41ce lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x215:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xac3ccf43bf8345ed expref: 45 pid: 188648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777502233.390251:0:186937:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd7226e400/0x4ad31463d9bc42d8 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x215:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xac3ccf43bf83463a expref: 45 pid: 186942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777502233.390260:0:186937:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd7eec9a00/0x4ad31463d9bc49f4 lrc: 5/0,1 mode: --/EX res: [0x200000bd2:0x215:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 186937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777502233.390300:0:186937:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd7226e400/0x4ad31463d9bc42d8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x215:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xac3ccf43bf83463a expref: 45 pid: 186942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777502233.390316:0:186937:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd7226e400/0x4ad31463d9bc42d8 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x215:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xac3ccf43bf83463a expref: 45 pid: 186942 timeout: 8460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777502233.390332:0:186937:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8dfc4d4a5500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:186937:1863837561412096:192.168.202.27@tcp:104: 00010000:00010000:2.0:1777502233.390416:0:186937:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd43979e00/0x4ad31463d9bc41ce lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x215:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xac3ccf43bf8345ed expref: 45 pid: 188648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777502233.390427:0:186937:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd43979e00/0x4ad31463d9bc41ce lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x215:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xac3ccf43bf8345ed expref: 45 pid: 188648 timeout: 8460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777502233.390437:0:186937:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8dfc4d4a7480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:186937:1863837561412224:192.168.202.27@tcp:104: 00000100:00100000:2.0:1777502233.390465:0:186937:0:(client.c:2691:ptlrpc_set_wait()) set ffff8dfd51ffac00 going to sleep for 11 seconds 00000100:00100000:0.0:1777502233.391469:0:186937:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8dfc4d4a5500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:186937:1863837561412096:192.168.202.27@tcp:104: 00000100:00100000:0.0:1777502233.391487:0:186937:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8dfc4d4a7480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:186937:1863837561412224:192.168.202.27@tcp:104: 00010000:00010000:0.0:1777502233.391532:0:186937:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd7eec9a00/0x4ad31463d9bc49f4 lrc: 3/0,1 mode: --/EX res: [0x200000bd2:0x215:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 186937 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777502233.391709:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1777502233.391751:0:205389:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837563156480 00000100:00100000:3.0:1777502233.391757:0:205389:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837563156480 00000100:00100000:0.0:1777502233.391779:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:3.0:1777502233.391793:0:205389:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd43979e00/0x4ad31463d9bc41ce lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x215:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xac3ccf43bf8345ed expref: 46 pid: 188648 timeout: 8460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777502233.391872:0:205388:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837563156608 00000100:00100000:0.0:1777502233.391877:0:205388:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837563156608 00000100:00100000:3.0:1777502233.391888:0:205389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1158 00010000:00010000:0.0:1777502233.391898:0:205388:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd7226e400/0x4ad31463d9bc42d8 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x215:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xac3ccf43bf83463a expref: 47 pid: 186942 timeout: 8460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777502233.391903:0:205389:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfc4ddb7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:0775d2ab-558e-41f1-82c0-14244d133390+47:2371:x1863837563156480:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1777502233.391920:0:205389:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1777502233.391928:0:205389:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd43979e00/0x4ad31463d9bc41ce lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x215:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xac3ccf43bf8345ed expref: 47 pid: 188648 timeout: 8460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777502233.391939:0:205388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1159 00010000:00010000:3.0:1777502233.391942:0:205389:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd43979e00/0x4ad31463d9bc41ce lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x215:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xac3ccf43bf8345ed expref: 47 pid: 188648 timeout: 8460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777502233.391952:0:205388:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfc4f557850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:0775d2ab-558e-41f1-82c0-14244d133390+47:2370:x1863837563156608:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1777502233.391962:0:205388:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1777502233.391964:0:205389:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd43979e00/0x4ad31463d9bc41ce lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x215:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xac3ccf43bf8345ed expref: 47 pid: 188648 timeout: 8460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.391970:0:205388:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd7226e400/0x4ad31463d9bc42d8 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x215:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xac3ccf43bf83463a expref: 47 pid: 186942 timeout: 8460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.392003:0:205388:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd7226e400/0x4ad31463d9bc42d8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x215:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xac3ccf43bf83463a expref: 46 pid: 186942 timeout: 8460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.392013:0:205389:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x215:0x0].0x0 (ffff8dfd5b1cf000) 00010000:00010000:3.0:1777502233.392017:0:205389:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd7eec9a00/0x4ad31463d9bc49f4 lrc: 3/0,1 mode: --/EX res: [0x200000bd2:0x215:0x0].0x0 bits 0x3/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 186937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.392023:0:205389:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd7eec9a00/0x4ad31463d9bc49f4 lrc: 3/0,1 mode: --/EX res: [0x200000bd2:0x215:0x0].0x0 bits 0x3/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 186937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.392028:0:205389:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1777502233.392039:0:205388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd7226e400/0x4ad31463d9bc42d8 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x215:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xac3ccf43bf83463a expref: 46 pid: 186942 timeout: 8460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.392055:0:205388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x215:0x0].0x0 (ffff8dfd5b1cf000) 00010000:00010000:0.0:1777502233.392060:0:205388:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd7eec9a00/0x4ad31463d9bc49f4 lrc: 3/0,1 mode: --/EX res: [0x200000bd2:0x215:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 186937 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777502233.392068:0:205389:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfc4ddb7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:0775d2ab-558e-41f1-82c0-14244d133390+45:2371:x1863837563156480:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 168us (357us total) trans 0 rc 0/0 00010000:00010000:0.0:1777502233.392071:0:205388:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd7eec9a00/0x4ad31463d9bc49f4 lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x215:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 186937 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777502233.392086:0:205389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1158 00010000:00010000:0.0:1777502233.392098:0:205388:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd7eec9a00/0x4ad31463d9bc49f4 lrc: 4/0,1 mode: EX/EX res: [0x200000bd2:0x215:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 186937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.392128:0:205388:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1777502233.392155:0:205388:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfc4f557850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:0775d2ab-558e-41f1-82c0-14244d133390+44:2370:x1863837563156608:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 205us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1777502233.392164:0:205388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1159 00010000:00010000:0.0:1777502233.392230:0:186937:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd7eec9a00/0x4ad31463d9bc49f4 lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x215:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 186937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.392237:0:186937:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd7eec9a00/0x4ad31463d9bc49f4 lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x215:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 186937 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1777502233.392975:0:186937:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].538, 64 off42624 00010000:00010000:0.0:1777502233.393071:0:186937:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6d600/0x4ad31463d9bc49fb lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x215:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 186937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.393082:0:186937:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6d600/0x4ad31463d9bc49fb lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x215:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 186937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.393092:0:186937:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6d600/0x4ad31463d9bc49fb lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x215:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 186937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.393100:0:186937:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6d600/0x4ad31463d9bc49fb lrc: 4/0,1 mode: PW/PW res: [0x200000bd2:0x215:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 186937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.393106:0:186937:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6d600/0x4ad31463d9bc49fb lrc: 4/0,1 mode: PW/PW res: [0x200000bd2:0x215:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 186937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.393113:0:186937:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6d600/0x4ad31463d9bc49fb lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x215:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 186937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.393161:0:186937:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1777502233.393180:0:186937:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd7eec9a00/0x4ad31463d9bc49f4 lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x215:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 186937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.393184:0:205387:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1777502233.393188:0:186937:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd7eec9a00/0x4ad31463d9bc49f4 lrc: 2/0,0 mode: EX/EX res: [0x200000bd2:0x215:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 186937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.393191:0:205387:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6d600/0x4ad31463d9bc49fb lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x215:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x40010480000000 pid: 186937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.393196:0:186937:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd7eec9a00/0x4ad31463d9bc49f4 lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0x215:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 186937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.393211:0:186937:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfd7eec9a00 already unused, calling callback (ffffffffc1e434f0) 00010000:00010000:0.0:1777502233.393216:0:186937:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd7eec9a00/0x4ad31463d9bc49f4 lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0x215:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 186937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.393228:0:205387:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfd77e6d600 already unused, calling callback (ffffffffc13f52e0) 00010000:00010000:0.0:1777502233.393230:0:186937:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd7eec9a00/0x4ad31463d9bc49f4 lrc: 4/0,0 mode: EX/EX res: [0x200000bd2:0x215:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 186937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.393234:0:205387:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6d600/0x4ad31463d9bc49fb lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x215:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x40010480000000 pid: 186937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.393245:0:186937:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x215:0x0].0x0 (ffff8dfd5b1cf000) 00010000:00010000:0.0:1777502233.393249:0:186937:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1777502233.393257:0:205387:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6d600/0x4ad31463d9bc49fb lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x215:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 186937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.393259:0:186937:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd7eec9a00/0x4ad31463d9bc49f4 lrc: 2/0,0 mode: --/EX res: [0x200000bd2:0x215:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 186937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.393273:0:186937:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd7eec9a00/0x4ad31463d9bc49f4 lrc: 0/0,0 mode: --/EX res: [0x200000bd2:0x215:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 186937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.393277:0:205387:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x215:0x0].0x0 (ffff8dfd5b1cf000) 00010000:00010000:3.0:1777502233.393281:0:205387:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1777502233.393285:0:205387:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6d600/0x4ad31463d9bc49fb lrc: 1/0,0 mode: --/PW res: [0x200000bd2:0x215:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 186937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.393292:0:205387:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6d600/0x4ad31463d9bc49fb lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0x215:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 186937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.393293:0:186937:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd7eec9400/0x4ad31463d9bc49e6 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 186937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.393307:0:186937:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd7eec9400/0x4ad31463d9bc49e6 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 186937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.393314:0:205387:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777502233.393317:0:205387:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777502233.393324:0:186937:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd7eec9400/0x4ad31463d9bc49e6 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 186937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.393326:0:205387:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777502233.393333:0:186937:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfd7eec9400 already unused, calling callback (ffffffffc1e434f0) 00010000:00010000:0.0:1777502233.393337:0:186937:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd7eec9400/0x4ad31463d9bc49e6 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 186937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.393344:0:186937:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd7eec9400/0x4ad31463d9bc49e6 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 186937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.393355:0:186937:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffff8dfd7f712b00) 00010000:00010000:0.0:1777502233.393358:0:186937:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777502233.393362:0:186937:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd7eec9400/0x4ad31463d9bc49e6 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 186937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.393367:0:186937:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd7eec9400/0x4ad31463d9bc49e6 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 186937 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1777502233.393379:0:186937:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000d4c80bd8 reply state 00000000654191db transno 8589939076 ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd7eec8600/0x4ad31463d9bc49ed lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 186937 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777502233.393387:0:186937:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1777502233.393443:0:186937:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfc4ddb6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4254d622-1c5a-45a0-aa2f-9afde5f83f6d+25:274351:x1863837563156352:12345-192.168.202.27@tcp:36:rm.0 Request processed in 3483us (3606us total) trans 8589939076 rc 0/0 00000100:00100000:0.0:1777502233.393451:0:186937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3835 00010000:00010000:3.0:1777502233.394190:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd7eec8600/0x4ad31463d9bc49ed lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 186937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.394200:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd7eec8600/0x4ad31463d9bc49ed lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 186937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.394206:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd7eec8600/0x4ad31463d9bc49ed lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 186937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.394212:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfd7eec8600 already unused, calling callback (ffffffffc1e434f0) 00010000:00010000:3.0:1777502233.394217:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd7eec8600/0x4ad31463d9bc49ed lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 186937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.394235:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd7eec8600/0x4ad31463d9bc49ed lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 186937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.394248:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x858dc0a8 (ffff8dfd80102700) 00010000:00010000:3.0:1777502233.394251:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777502233.394254:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd7eec8600/0x4ad31463d9bc49ed lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 186937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.394261:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd7eec8600/0x4ad31463d9bc49ed lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 186937 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777502233.394649:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1777502233.394727:0:205372:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837563156736 00000100:00100000:0.0:1777502233.394745:0:205372:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837563156736 00000100:00100000:0.0:1777502233.394788:0:205372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3836 00000100:00100000:0.0:1777502233.394799:0:205372:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfd7c2ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:4254d622-1c5a-45a0-aa2f-9afde5f83f6d+24:274351:x1863837563156736:12345-192.168.202.27@tcp:101:rm.0 00010000:00010000:0.0:1777502233.394832:0:205372:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777502233.394846:0:205372:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6dc00/0x4ad31463d9bc4a02 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac3ccf43bf834767 expref: -99 pid: 205372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.394899:0:205372:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6d800/0x4ad31463d9bc4a09 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 205372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.394911:0:205372:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6d800/0x4ad31463d9bc4a09 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 205372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.394921:0:205372:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6d800/0x4ad31463d9bc4a09 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 205372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.394934:0:205372:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6de00/0x4ad31463d9bc4a10 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.394942:0:205372:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6de00/0x4ad31463d9bc4a10 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.394959:0:205372:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6de00/0x4ad31463d9bc4a10 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.395054:0:205372:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6da00/0x4ad31463d9bc4a17 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x216:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 205372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.395065:0:205372:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6da00/0x4ad31463d9bc4a17 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x216:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 205372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.395074:0:205372:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6da00/0x4ad31463d9bc4a17 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x216:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 205372 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1777502233.395112:0:205372:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd2:0x216:0x0]: returning size 0 00000004:00200000:0.0:1777502233.395122:0:205372:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1777502233.395140:0:205372:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6da00/0x4ad31463d9bc4a17 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x216:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 205372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.395152:0:205372:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6da00/0x4ad31463d9bc4a17 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x216:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 205372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.395161:0:205372:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6d800/0x4ad31463d9bc4a09 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 205372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.395167:0:205372:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6d800/0x4ad31463d9bc4a09 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 205372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.395174:0:205372:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6d800/0x4ad31463d9bc4a09 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 205372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.395178:0:205372:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfd77e6d800 already unused, calling callback (ffffffffc1e434f0) 00010000:00010000:0.0:1777502233.395181:0:205372:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6d800/0x4ad31463d9bc4a09 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 205372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.395186:0:205372:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6d800/0x4ad31463d9bc4a09 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 205372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.395194:0:205372:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffff8dfd7f712b00) 00010000:00010000:0.0:1777502233.395196:0:205372:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777502233.395199:0:205372:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6d800/0x4ad31463d9bc4a09 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 205372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.395203:0:205372:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6d800/0x4ad31463d9bc4a09 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 205372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.395212:0:205372:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6de00/0x4ad31463d9bc4a10 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.395223:0:205372:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6de00/0x4ad31463d9bc4a10 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 205372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.395227:0:205372:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6de00/0x4ad31463d9bc4a10 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.395231:0:205372:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfd77e6de00 already unused, calling callback (ffffffffc1e434f0) 00010000:00010000:0.0:1777502233.395234:0:205372:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6de00/0x4ad31463d9bc4a10 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.395238:0:205372:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6de00/0x4ad31463d9bc4a10 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 205372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.395245:0:205372:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x7cebc0a8 (ffff8dfd7fc41a00) 00010000:00010000:0.0:1777502233.395248:0:205372:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777502233.395250:0:205372:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6de00/0x4ad31463d9bc4a10 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.395254:0:205372:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6de00/0x4ad31463d9bc4a10 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.395281:0:205372:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6dc00/0x4ad31463d9bc4a02 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xac3ccf43bf834767 expref: 26 pid: 205372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.395295:0:205372:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6da00/0x4ad31463d9bc4a17 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x216:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xac3ccf43bf834767 expref: 25 pid: 205372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.395302:0:205372:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x216:0x0].0x0 (ffff8dfd67320400) 00010000:00010000:0.0:1777502233.395305:0:205372:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1777502233.395314:0:205372:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dfd77e6da00, rc 0) 00000100:00100000:0.0:1777502233.395358:0:205372:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfd7c2ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:4254d622-1c5a-45a0-aa2f-9afde5f83f6d+25:274351:x1863837563156736:12345-192.168.202.27@tcp:101:rm.0 Request processed in 560us (711us total) trans 0 rc 0/0 00000100:00100000:0.0:1777502233.395366:0:205372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3836 00000100:00100000:0.0:1777502233.396919:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1777502233.396951:0:205369:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837563156992 00000100:00100000:3.0:1777502233.396958:0:205369:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837563156992 00000100:00100000:3.0:1777502233.397004:0:205369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3837 00000100:00100000:3.0:1777502233.397014:0:205369:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfc4ddb7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:4254d622-1c5a-45a0-aa2f-9afde5f83f6d+25:274351:x1863837563156992:12345-192.168.202.27@tcp:36:rm.0 00010000:00010000:3.0:1777502233.397054:0:205369:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1777502233.397073:0:205369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6da00/0x4ad31463d9bc4a17 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x216:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xac3ccf43bf834767 expref: 25 pid: 205372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.397089:0:205369:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x216:0x0].0x0 (ffff8dfd67320400) 00010000:00010000:3.0:1777502233.397094:0:205369:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1777502233.397110:0:205369:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da57c00/0x4ad31463d9bc4a1e lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 205369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.397121:0:205369:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da57c00/0x4ad31463d9bc4a1e lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 205369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.397131:0:205369:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da57c00/0x4ad31463d9bc4a1e lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 205369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.397154:0:205369:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da57a00/0x4ad31463d9bc4a25 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.397162:0:205369:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da57a00/0x4ad31463d9bc4a25 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.397170:0:205369:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da57a00/0x4ad31463d9bc4a25 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.397271:0:205369:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da57400/0x4ad31463d9bc4a2c lrc: 3/0,1 mode: --/EX res: [0x200000bd2:0x216:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 205369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.397283:0:205369:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd40031800/0x4ad31463d9bc41f8 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x216:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xac3ccf43bf834609 expref: 43 pid: 186942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.397292:0:205369:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da57400/0x4ad31463d9bc4a2c lrc: 4/0,1 mode: --/EX res: [0x200000bd2:0x216:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 205369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.397323:0:205369:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd40031800/0x4ad31463d9bc41f8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x216:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xac3ccf43bf834609 expref: 43 pid: 186942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.397338:0:205369:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd40031800/0x4ad31463d9bc41f8 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x216:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xac3ccf43bf834609 expref: 43 pid: 186942 timeout: 8460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777502233.397354:0:205369:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8dfd7c2ffb80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:205369:1863837561412352:192.168.202.27@tcp:104: 00000100:00100000:3.0:1777502233.397434:0:205369:0:(client.c:2691:ptlrpc_set_wait()) set ffff8dfc45a25600 going to sleep for 11 seconds 00000100:00100000:0.0:1777502233.398443:0:205369:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8dfd7c2ffb80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:205369:1863837561412352:192.168.202.27@tcp:104: 00010000:00010000:0.0:1777502233.398472:0:205369:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da57400/0x4ad31463d9bc4a2c lrc: 3/0,1 mode: --/EX res: [0x200000bd2:0x216:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 205369 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777502233.398648:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1777502233.398687:0:205589:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837563157120 00000100:00100000:0.0:1777502233.398692:0:205589:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837563157120 00010000:00010000:0.0:1777502233.398716:0:205589:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd40031800/0x4ad31463d9bc41f8 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x216:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xac3ccf43bf834609 expref: 44 pid: 186942 timeout: 8460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777502233.398762:0:205589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1160 00000100:00100000:0.0:1777502233.398773:0:205589:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfd7c2fd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:0775d2ab-558e-41f1-82c0-14244d133390+44:2371:x1863837563157120:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1777502233.398783:0:205589:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1777502233.398788:0:205589:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd40031800/0x4ad31463d9bc41f8 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x216:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xac3ccf43bf834609 expref: 44 pid: 186942 timeout: 8460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.398801:0:205589:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd40031800/0x4ad31463d9bc41f8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x216:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xac3ccf43bf834609 expref: 44 pid: 186942 timeout: 8460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.398819:0:205589:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd40031800/0x4ad31463d9bc41f8 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x216:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xac3ccf43bf834609 expref: 44 pid: 186942 timeout: 8460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.398833:0:205589:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x216:0x0].0x0 (ffff8dfd67320400) 00010000:00010000:0.0:1777502233.398848:0:205589:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da57400/0x4ad31463d9bc4a2c lrc: 3/0,1 mode: --/EX res: [0x200000bd2:0x216:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 205369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.398857:0:205589:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da57400/0x4ad31463d9bc4a2c lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x216:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 205369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.398864:0:205589:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da57400/0x4ad31463d9bc4a2c lrc: 4/0,1 mode: EX/EX res: [0x200000bd2:0x216:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 205369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.398892:0:205589:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1777502233.398922:0:205369:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da57400/0x4ad31463d9bc4a2c lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x216:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 205369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.398934:0:205369:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da57400/0x4ad31463d9bc4a2c lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x216:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 205369 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777502233.398940:0:205589:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfd7c2fd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:0775d2ab-558e-41f1-82c0-14244d133390+43:2371:x1863837563157120:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 168us (292us total) trans 0 rc 0/0 00000100:00100000:0.0:1777502233.398949:0:205589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1160 00000040:00080000:3.0:1777502233.399721:0:205369:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].542, 64 off42880 00010000:00010000:3.0:1777502233.399810:0:205369:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da56200/0x4ad31463d9bc4a33 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x216:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 205369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.399819:0:205369:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da56200/0x4ad31463d9bc4a33 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x216:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 205369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.399826:0:205369:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da56200/0x4ad31463d9bc4a33 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x216:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 205369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.399831:0:205369:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da56200/0x4ad31463d9bc4a33 lrc: 4/0,1 mode: PW/PW res: [0x200000bd2:0x216:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 205369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.399836:0:205369:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da56200/0x4ad31463d9bc4a33 lrc: 4/0,1 mode: PW/PW res: [0x200000bd2:0x216:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 205369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.399840:0:205369:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da56200/0x4ad31463d9bc4a33 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x216:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 205369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.399857:0:205369:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1777502233.399876:0:205369:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da57400/0x4ad31463d9bc4a2c lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x216:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 205369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.399882:0:188362:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1777502233.399883:0:205369:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da57400/0x4ad31463d9bc4a2c lrc: 2/0,0 mode: EX/EX res: [0x200000bd2:0x216:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 205369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.399890:0:188362:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da56200/0x4ad31463d9bc4a33 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x216:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x40010480000000 pid: 205369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.399892:0:205369:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da57400/0x4ad31463d9bc4a2c lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0x216:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 205369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.399907:0:188362:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfd4da56200 already unused, calling callback (ffffffffc13f52e0) 00010000:00010000:0.0:1777502233.399913:0:188362:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da56200/0x4ad31463d9bc4a33 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x216:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x40010480000000 pid: 205369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.399934:0:205369:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfd4da57400 already unused, calling callback (ffffffffc1e434f0) 00010000:00010000:0.0:1777502233.399935:0:188362:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da56200/0x4ad31463d9bc4a33 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x216:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 205369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.399940:0:205369:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da57400/0x4ad31463d9bc4a2c lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0x216:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 205369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.399951:0:205369:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da57400/0x4ad31463d9bc4a2c lrc: 4/0,0 mode: EX/EX res: [0x200000bd2:0x216:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 205369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.399951:0:188362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x216:0x0].0x0 (ffff8dfd67320400) 00010000:00010000:0.0:1777502233.399958:0:188362:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1777502233.399964:0:188362:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da56200/0x4ad31463d9bc4a33 lrc: 1/0,0 mode: --/PW res: [0x200000bd2:0x216:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 205369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.399969:0:205369:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x216:0x0].0x0 (ffff8dfd67320400) 00010000:00010000:0.0:1777502233.399972:0:188362:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da56200/0x4ad31463d9bc4a33 lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0x216:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 205369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.399973:0:205369:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1777502233.399979:0:205369:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da57400/0x4ad31463d9bc4a2c lrc: 2/0,0 mode: --/EX res: [0x200000bd2:0x216:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 205369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.399987:0:205369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da57400/0x4ad31463d9bc4a2c lrc: 0/0,0 mode: --/EX res: [0x200000bd2:0x216:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 205369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.400007:0:188362:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777502233.400011:0:188362:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777502233.400014:0:205369:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da57c00/0x4ad31463d9bc4a1e lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 205369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.400015:0:188362:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777502233.400023:0:205369:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da57c00/0x4ad31463d9bc4a1e lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 205369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.400030:0:205369:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da57c00/0x4ad31463d9bc4a1e lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 205369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.400036:0:205369:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfd4da57c00 already unused, calling callback (ffffffffc1e434f0) 00010000:00010000:3.0:1777502233.400039:0:205369:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da57c00/0x4ad31463d9bc4a1e lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 205369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.400046:0:205369:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da57c00/0x4ad31463d9bc4a1e lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 205369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.400065:0:205369:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffff8dfd7f712b00) 00010000:00010000:3.0:1777502233.400068:0:205369:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777502233.400072:0:205369:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da57c00/0x4ad31463d9bc4a1e lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 205369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.400078:0:205369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da57c00/0x4ad31463d9bc4a1e lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 205369 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1777502233.400089:0:205369:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000ad98bd86 reply state 0000000048e49a28 transno 8589939077 ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da57a00/0x4ad31463d9bc4a25 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205369 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777502233.400098:0:205369:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1777502233.400155:0:205369:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfc4ddb7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:4254d622-1c5a-45a0-aa2f-9afde5f83f6d+26:274351:x1863837563156992:12345-192.168.202.27@tcp:36:rm.0 Request processed in 3143us (3242us total) trans 8589939077 rc 0/0 00000100:00100000:3.0:1777502233.400164:0:205369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3837 00010000:00010000:0.0:1777502233.400806:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da57a00/0x4ad31463d9bc4a25 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.400815:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da57a00/0x4ad31463d9bc4a25 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 205369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.400822:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da57a00/0x4ad31463d9bc4a25 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.400827:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfd4da57a00 already unused, calling callback (ffffffffc1e434f0) 00010000:00010000:0.0:1777502233.400831:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da57a00/0x4ad31463d9bc4a25 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.400837:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da57a00/0x4ad31463d9bc4a25 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 205369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.400848:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x7cebc0a8 (ffff8dfd47d8ba00) 00010000:00010000:0.0:1777502233.400851:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777502233.400855:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da57a00/0x4ad31463d9bc4a25 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.400861:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da57a00/0x4ad31463d9bc4a25 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205369 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777502233.401252:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1777502233.401301:0:186936:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837563157248 00000100:00100000:3.0:1777502233.401362:0:186936:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837563157248 00000100:00100000:3.0:1777502233.401409:0:186936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3838 00000100:00100000:3.0:1777502233.401420:0:186936:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfc4d4a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4254d622-1c5a-45a0-aa2f-9afde5f83f6d+25:274351:x1863837563157248:12345-192.168.202.27@tcp:101:rm.0 00010000:00010000:3.0:1777502233.401445:0:186936:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777502233.401459:0:186936:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da57200/0x4ad31463d9bc4a3a lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac3ccf43bf83476e expref: -99 pid: 186936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.401518:0:186936:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da56600/0x4ad31463d9bc4a41 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 186936 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.401528:0:186936:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da56600/0x4ad31463d9bc4a41 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 186936 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.401544:0:186936:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da56600/0x4ad31463d9bc4a41 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 186936 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.401555:0:186936:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da57800/0x4ad31463d9bc4a48 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 186936 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.401560:0:186936:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da57800/0x4ad31463d9bc4a48 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 186936 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.401565:0:186936:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da57800/0x4ad31463d9bc4a48 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 186936 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.401682:0:186936:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da56400/0x4ad31463d9bc4a4f lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x21c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 186936 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.401688:0:186936:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da56400/0x4ad31463d9bc4a4f lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x21c:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 186936 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.401693:0:186936:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da56400/0x4ad31463d9bc4a4f lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x21c:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 186936 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1777502233.401720:0:186936:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd2:0x21c:0x0]: returning size 0 00000004:00200000:3.0:1777502233.401724:0:186936:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1777502233.401745:0:186936:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da56400/0x4ad31463d9bc4a4f lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x21c:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 186936 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.401757:0:186936:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da56400/0x4ad31463d9bc4a4f lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x21c:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 186936 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.401766:0:186936:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da56600/0x4ad31463d9bc4a41 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 186936 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.401780:0:186936:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da56600/0x4ad31463d9bc4a41 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 186936 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.401787:0:186936:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da56600/0x4ad31463d9bc4a41 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 186936 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.401793:0:186936:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfd4da56600 already unused, calling callback (ffffffffc1e434f0) 00010000:00010000:3.0:1777502233.401797:0:186936:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da56600/0x4ad31463d9bc4a41 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 186936 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.401804:0:186936:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da56600/0x4ad31463d9bc4a41 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 186936 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.401814:0:186936:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffff8dfd7f712b00) 00010000:00010000:3.0:1777502233.401818:0:186936:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777502233.401821:0:186936:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da56600/0x4ad31463d9bc4a41 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 186936 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.401828:0:186936:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da56600/0x4ad31463d9bc4a41 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 186936 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.401841:0:186936:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da57800/0x4ad31463d9bc4a48 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 186936 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.401845:0:186936:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da57800/0x4ad31463d9bc4a48 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 186936 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.401850:0:186936:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da57800/0x4ad31463d9bc4a48 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 186936 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.401853:0:186936:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfd4da57800 already unused, calling callback (ffffffffc1e434f0) 00010000:00010000:3.0:1777502233.401860:0:186936:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da57800/0x4ad31463d9bc4a48 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 186936 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.401865:0:186936:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da57800/0x4ad31463d9bc4a48 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 186936 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.401872:0:186936:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0xa59895a8 (ffff8dfd47d8b700) 00010000:00010000:3.0:1777502233.401874:0:186936:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777502233.401877:0:186936:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da57800/0x4ad31463d9bc4a48 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 186936 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.401880:0:186936:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da57800/0x4ad31463d9bc4a48 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 186936 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.401907:0:186936:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da57200/0x4ad31463d9bc4a3a lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xac3ccf43bf83476e expref: 27 pid: 186936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.401921:0:186936:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da56400/0x4ad31463d9bc4a4f lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x21c:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xac3ccf43bf83476e expref: 26 pid: 186936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.401929:0:186936:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x21c:0x0].0x0 (ffff8dfd58bbec00) 00010000:00010000:3.0:1777502233.401931:0:186936:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1777502233.401935:0:186936:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dfd4da56400, rc 0) 00000100:00100000:3.0:1777502233.401979:0:186936:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfc4d4a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4254d622-1c5a-45a0-aa2f-9afde5f83f6d+26:274351:x1863837563157248:12345-192.168.202.27@tcp:101:rm.0 Request processed in 561us (730us total) trans 0 rc 0/0 00000100:00100000:3.0:1777502233.401988:0:186936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3838 00000100:00100000:3.0:1777502233.403067:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1777502233.403107:0:205372:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837563157504 00000100:00100000:0.0:1777502233.403113:0:205372:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837563157504 00000100:00100000:0.0:1777502233.403155:0:205372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3839 00000100:00100000:0.0:1777502233.403164:0:205372:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfd7c2fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:4254d622-1c5a-45a0-aa2f-9afde5f83f6d+26:274351:x1863837563157504:12345-192.168.202.27@tcp:36:rm.0 00010000:00010000:0.0:1777502233.403201:0:205372:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1777502233.403217:0:205372:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da56400/0x4ad31463d9bc4a4f lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x21c:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xac3ccf43bf83476e expref: 26 pid: 186936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.403229:0:205372:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x21c:0x0].0x0 (ffff8dfd58bbec00) 00010000:00010000:0.0:1777502233.403232:0:205372:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1777502233.403244:0:205372:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6de00/0x4ad31463d9bc4a56 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 205372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.403251:0:205372:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6de00/0x4ad31463d9bc4a56 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 205372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.403257:0:205372:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6de00/0x4ad31463d9bc4a56 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 205372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.403268:0:205372:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6d800/0x4ad31463d9bc4a5d lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.403276:0:205372:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6d800/0x4ad31463d9bc4a5d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.403284:0:205372:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6d800/0x4ad31463d9bc4a5d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.403376:0:205372:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6ce00/0x4ad31463d9bc4a64 lrc: 3/0,1 mode: --/EX res: [0x200000bd2:0x21c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 205372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.403387:0:205372:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da56e00/0x4ad31463d9bc4460 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x21c:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xac3ccf43bf834680 expref: 42 pid: 186942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.403398:0:205372:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd505ee000/0x4ad31463d9bc4475 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x21c:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xac3ccf43bf8346b1 expref: 42 pid: 186941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.403409:0:205372:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd7eec8c00/0x4ad31463d9bc47f5 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x21c:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xac3ccf43bf83470c expref: 42 pid: 186941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.403414:0:205372:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6ce00/0x4ad31463d9bc4a64 lrc: 6/0,1 mode: --/EX res: [0x200000bd2:0x21c:0x0].0x0 bits 0x3/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 205372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.403437:0:205372:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd7eec8c00/0x4ad31463d9bc47f5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x21c:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xac3ccf43bf83470c expref: 42 pid: 186941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.403448:0:205372:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd7eec8c00/0x4ad31463d9bc47f5 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x21c:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xac3ccf43bf83470c expref: 42 pid: 186941 timeout: 8460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777502233.403459:0:205372:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8dfc4ddb7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:205372:1863837561412480:192.168.202.27@tcp:104: 00010000:00010000:0.0:1777502233.403547:0:205372:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd505ee000/0x4ad31463d9bc4475 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x21c:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xac3ccf43bf8346b1 expref: 42 pid: 186941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.403558:0:205372:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd505ee000/0x4ad31463d9bc4475 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x21c:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xac3ccf43bf8346b1 expref: 42 pid: 186941 timeout: 8460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777502233.403569:0:205372:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8dfc4ddb4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:205372:1863837561412608:192.168.202.27@tcp:104: 00010000:00010000:0.0:1777502233.403648:0:205372:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da56e00/0x4ad31463d9bc4460 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x21c:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xac3ccf43bf834680 expref: 42 pid: 186942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.403655:0:205372:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da56e00/0x4ad31463d9bc4460 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x21c:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xac3ccf43bf834680 expref: 42 pid: 186942 timeout: 8460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777502233.403672:0:205372:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8dfc4ddb6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:205372:1863837561412736:192.168.202.27@tcp:104: 00000100:00100000:0.0:1777502233.403706:0:205372:0:(client.c:2691:ptlrpc_set_wait()) set ffff8dfc49092cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1777502233.404509:0:205372:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8dfc4ddb7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:205372:1863837561412480:192.168.202.27@tcp:104: 00000100:00100000:0.0:1777502233.404854:0:205372:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8dfc4ddb4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:205372:1863837561412608:192.168.202.27@tcp:104: 00000100:00100000:2.0:1777502233.405061:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1777502233.405073:0:205372:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8dfc4ddb6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:205372:1863837561412736:192.168.202.27@tcp:104: 00000100:00100000:3.0:1777502233.405104:0:186923:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837563157632 00000100:00100000:3.0:1777502233.405111:0:186923:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837563157632 00010000:00010000:0.0:1777502233.405117:0:205372:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6ce00/0x4ad31463d9bc4a64 lrc: 3/0,1 mode: --/EX res: [0x200000bd2:0x21c:0x0].0x0 bits 0x3/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 205372 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777502233.405125:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1777502233.405158:0:188208:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837563157760 00000100:00100000:2.0:1777502233.405162:0:188208:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837563157760 00010000:00010000:2.0:1777502233.405183:0:188208:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd505ee000/0x4ad31463d9bc4475 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x21c:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xac3ccf43bf8346b1 expref: 44 pid: 186941 timeout: 8460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.405196:0:186923:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd7eec8c00/0x4ad31463d9bc47f5 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x21c:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xac3ccf43bf83470c expref: 44 pid: 186941 timeout: 8460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777502233.405227:0:188208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1161 00000100:00100000:2.0:1777502233.405238:0:188208:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfc4d4a5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0775d2ab-558e-41f1-82c0-14244d133390+44:2371:x1863837563157760:12345-192.168.202.27@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1777502233.405243:0:186923:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1162 00010000:00010000:2.0:1777502233.405252:0:188208:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1777502233.405257:0:186923:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfc4d4a7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0775d2ab-558e-41f1-82c0-14244d133390+44:2371:x1863837563157632:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1777502233.405259:0:188208:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd505ee000/0x4ad31463d9bc4475 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x21c:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xac3ccf43bf8346b1 expref: 44 pid: 186941 timeout: 8460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.405272:0:186923:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1777502233.405273:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:3.0:1777502233.405283:0:186923:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd7eec8c00/0x4ad31463d9bc47f5 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x21c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xac3ccf43bf83470c expref: 44 pid: 186941 timeout: 8460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777502233.405284:0:188208:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd505ee000/0x4ad31463d9bc4475 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x21c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xac3ccf43bf8346b1 expref: 44 pid: 186941 timeout: 8460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.405308:0:186923:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd7eec8c00/0x4ad31463d9bc47f5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x21c:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xac3ccf43bf83470c expref: 44 pid: 186941 timeout: 8460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777502233.405311:0:205388:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837563157888 00000100:00100000:0.0:1777502233.405316:0:205388:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837563157888 00010000:00010000:0.0:1777502233.405336:0:205388:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da56e00/0x4ad31463d9bc4460 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x21c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xac3ccf43bf834680 expref: 45 pid: 186942 timeout: 8460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777502233.405376:0:205388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1163 00010000:00010000:2.0:1777502233.405379:0:188208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd505ee000/0x4ad31463d9bc4475 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x21c:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xac3ccf43bf8346b1 expref: 45 pid: 186941 timeout: 8460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.405385:0:186923:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd7eec8c00/0x4ad31463d9bc47f5 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x21c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xac3ccf43bf83470c expref: 45 pid: 186941 timeout: 8460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777502233.405390:0:205388:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfc4ddb6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:0775d2ab-558e-41f1-82c0-14244d133390+45:2371:x1863837563157888:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1777502233.405402:0:188208:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x21c:0x0].0x0 (ffff8dfd58bbec00) 00010000:00010000:0.0:1777502233.405406:0:205388:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1777502233.405408:0:188208:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6ce00/0x4ad31463d9bc4a64 lrc: 3/0,1 mode: --/EX res: [0x200000bd2:0x21c:0x0].0x0 bits 0x3/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 205372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.405414:0:205388:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da56e00/0x4ad31463d9bc4460 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x21c:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xac3ccf43bf834680 expref: 43 pid: 186942 timeout: 8460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777502233.405419:0:188208:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6ce00/0x4ad31463d9bc4a64 lrc: 3/0,1 mode: --/EX res: [0x200000bd2:0x21c:0x0].0x0 bits 0x3/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 205372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777502233.405431:0:188208:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1777502233.405432:0:186923:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x21c:0x0].0x0 (ffff8dfd58bbec00) 00010000:00010000:3.0:1777502233.405437:0:186923:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6ce00/0x4ad31463d9bc4a64 lrc: 3/0,1 mode: --/EX res: [0x200000bd2:0x21c:0x0].0x0 bits 0x3/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 205372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.405445:0:186923:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6ce00/0x4ad31463d9bc4a64 lrc: 3/0,1 mode: --/EX res: [0x200000bd2:0x21c:0x0].0x0 bits 0x3/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 205372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.405451:0:186923:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1777502233.405458:0:205388:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da56e00/0x4ad31463d9bc4460 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x21c:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xac3ccf43bf834680 expref: 43 pid: 186942 timeout: 8460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777502233.405471:0:188208:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfc4d4a5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0775d2ab-558e-41f1-82c0-14244d133390+43:2371:x1863837563157760:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 234us (347us total) trans 0 rc 0/0 00010000:00010000:0.0:1777502233.405477:0:205388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da56e00/0x4ad31463d9bc4460 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x21c:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xac3ccf43bf834680 expref: 43 pid: 186942 timeout: 8460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777502233.405481:0:186923:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfc4d4a7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0775d2ab-558e-41f1-82c0-14244d133390+43:2371:x1863837563157632:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 228us (422us total) trans 0 rc 0/0 00000100:00100000:2.0:1777502233.405510:0:188208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1161 00000100:00100000:3.0:1777502233.405520:0:186923:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1162 00010000:00010000:0.0:1777502233.405521:0:205388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x21c:0x0].0x0 (ffff8dfd58bbec00) 00010000:00010000:0.0:1777502233.405527:0:205388:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6ce00/0x4ad31463d9bc4a64 lrc: 3/0,1 mode: --/EX res: [0x200000bd2:0x21c:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 205372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.405535:0:205388:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6ce00/0x4ad31463d9bc4a64 lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x21c:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 205372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.405542:0:205388:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6ce00/0x4ad31463d9bc4a64 lrc: 4/0,1 mode: EX/EX res: [0x200000bd2:0x21c:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 205372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.405564:0:205388:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1777502233.405614:0:205388:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfc4ddb6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:0775d2ab-558e-41f1-82c0-14244d133390+40:2371:x1863837563157888:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 229us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1777502233.405623:0:205388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1163 00010000:00010000:0.0:1777502233.405654:0:205372:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6ce00/0x4ad31463d9bc4a64 lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x21c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 205372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.405661:0:205372:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6ce00/0x4ad31463d9bc4a64 lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x21c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 205372 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1777502233.406328:0:205372:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].543, 64 off42944 00010000:00010000:0.0:1777502233.406413:0:205372:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6d200/0x4ad31463d9bc4a6b lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x21c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 205372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.406424:0:205372:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6d200/0x4ad31463d9bc4a6b lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x21c:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 205372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.406433:0:205372:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6d200/0x4ad31463d9bc4a6b lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x21c:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 205372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.406450:0:205372:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6d200/0x4ad31463d9bc4a6b lrc: 4/0,1 mode: PW/PW res: [0x200000bd2:0x21c:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 205372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.406456:0:205372:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6d200/0x4ad31463d9bc4a6b lrc: 4/0,1 mode: PW/PW res: [0x200000bd2:0x21c:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 205372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.406462:0:205372:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6d200/0x4ad31463d9bc4a6b lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x21c:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 205372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.406484:0:205372:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1777502233.406512:0:205372:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6ce00/0x4ad31463d9bc4a64 lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x21c:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 205372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777502233.406515:0:186924:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1777502233.406521:0:205372:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6ce00/0x4ad31463d9bc4a64 lrc: 2/0,0 mode: EX/EX res: [0x200000bd2:0x21c:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 205372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777502233.406523:0:186924:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6d200/0x4ad31463d9bc4a6b lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x21c:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x40010480000000 pid: 205372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.406530:0:205372:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6ce00/0x4ad31463d9bc4a64 lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0x21c:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 205372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777502233.406532:0:186924:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfd77e6d200 already unused, calling callback (ffffffffc13f52e0) 00010000:00010000:2.0:1777502233.406538:0:186924:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6d200/0x4ad31463d9bc4a6b lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x21c:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x40010480000000 pid: 205372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.406540:0:205372:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfd77e6ce00 already unused, calling callback (ffffffffc1e434f0) 00010000:00010000:0.0:1777502233.406546:0:205372:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6ce00/0x4ad31463d9bc4a64 lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0x21c:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 205372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777502233.406548:0:186924:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6d200/0x4ad31463d9bc4a6b lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x21c:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x40018480000000 pid: 205372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.406562:0:205372:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6ce00/0x4ad31463d9bc4a64 lrc: 4/0,0 mode: EX/EX res: [0x200000bd2:0x21c:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 205372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777502233.406568:0:186924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x21c:0x0].0x0 (ffff8dfd58bbec00) 00010000:00010000:2.0:1777502233.406573:0:186924:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1777502233.406599:0:205372:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x21c:0x0].0x0 (ffff8dfd58bbec00) 00010000:00010000:0.0:1777502233.406604:0:205372:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1777502233.406605:0:186924:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6d200/0x4ad31463d9bc4a6b lrc: 1/0,0 mode: --/PW res: [0x200000bd2:0x21c:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 205372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.406607:0:205372:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6ce00/0x4ad31463d9bc4a64 lrc: 2/0,0 mode: --/EX res: [0x200000bd2:0x21c:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 205372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777502233.406621:0:186924:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6d200/0x4ad31463d9bc4a6b lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0x21c:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x44819480000000 pid: 205372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777502233.406635:0:186924:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777502233.406635:0:205372:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6ce00/0x4ad31463d9bc4a64 lrc: 0/0,0 mode: --/EX res: [0x200000bd2:0x21c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 205372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777502233.406638:0:186924:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777502233.406641:0:186924:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777502233.406659:0:205372:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6de00/0x4ad31463d9bc4a56 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 205372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.406665:0:205372:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6de00/0x4ad31463d9bc4a56 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 205372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.406672:0:205372:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6de00/0x4ad31463d9bc4a56 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 205372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.406677:0:205372:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfd77e6de00 already unused, calling callback (ffffffffc1e434f0) 00010000:00010000:0.0:1777502233.406680:0:205372:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6de00/0x4ad31463d9bc4a56 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 205372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.406688:0:205372:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6de00/0x4ad31463d9bc4a56 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 205372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.406698:0:205372:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffff8dfd7f712b00) 00010000:00010000:0.0:1777502233.406701:0:205372:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777502233.406704:0:205372:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6de00/0x4ad31463d9bc4a56 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 205372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.406711:0:205372:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6de00/0x4ad31463d9bc4a56 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 205372 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1777502233.406722:0:205372:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000006cb24df3 reply state 000000008bc2071f transno 8589939078 ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6d800/0x4ad31463d9bc4a5d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205372 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777502233.406728:0:205372:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1777502233.406780:0:205372:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfd7c2fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:4254d622-1c5a-45a0-aa2f-9afde5f83f6d+27:274351:x1863837563157504:12345-192.168.202.27@tcp:36:rm.0 Request processed in 3618us (3716us total) trans 8589939078 rc 0/0 00000100:00100000:0.0:1777502233.406787:0:205372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3839 00010000:00010000:3.0:1777502233.407423:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6d800/0x4ad31463d9bc4a5d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.407439:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6d800/0x4ad31463d9bc4a5d lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 205372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.407444:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6d800/0x4ad31463d9bc4a5d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.407448:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfd77e6d800 already unused, calling callback (ffffffffc1e434f0) 00010000:00010000:3.0:1777502233.407451:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6d800/0x4ad31463d9bc4a5d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.407455:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6d800/0x4ad31463d9bc4a5d lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 205372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.407464:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0xa59895a8 (ffff8dfd7fc41a00) 00010000:00010000:3.0:1777502233.407468:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777502233.407470:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6d800/0x4ad31463d9bc4a5d lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.407475:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6d800/0x4ad31463d9bc4a5d lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205372 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777502233.407905:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1777502233.407950:0:187571:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837563158016 00000100:00100000:0.0:1777502233.407958:0:187571:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837563158016 00000100:00100000:0.0:1777502233.407999:0:187571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3840 00000100:00100000:0.0:1777502233.408010:0:187571:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfd67668380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4254d622-1c5a-45a0-aa2f-9afde5f83f6d+26:274351:x1863837563158016:12345-192.168.202.27@tcp:101:rm.0 00010000:00010000:0.0:1777502233.408032:0:187571:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777502233.408047:0:187571:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6ca00/0x4ad31463d9bc4a72 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac3ccf43bf834775 expref: -99 pid: 187571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.408099:0:187571:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6c200/0x4ad31463d9bc4a79 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 187571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.408108:0:187571:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6c200/0x4ad31463d9bc4a79 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 187571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.408119:0:187571:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6c200/0x4ad31463d9bc4a79 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 187571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.408133:0:187571:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6d000/0x4ad31463d9bc4a80 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.408142:0:187571:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6d000/0x4ad31463d9bc4a80 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.408150:0:187571:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6d000/0x4ad31463d9bc4a80 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.408244:0:187571:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6cc00/0x4ad31463d9bc4a87 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x219:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 187571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.408265:0:187571:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6cc00/0x4ad31463d9bc4a87 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x219:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 187571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.408274:0:187571:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6cc00/0x4ad31463d9bc4a87 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x219:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 187571 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1777502233.408304:0:187571:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd2:0x219:0x0]: returning size 0 00000004:00200000:0.0:1777502233.408309:0:187571:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1777502233.408336:0:187571:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6cc00/0x4ad31463d9bc4a87 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x219:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 187571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.408348:0:187571:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6cc00/0x4ad31463d9bc4a87 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x219:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 187571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.408356:0:187571:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6c200/0x4ad31463d9bc4a79 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 187571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.408363:0:187571:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6c200/0x4ad31463d9bc4a79 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 187571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.408369:0:187571:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6c200/0x4ad31463d9bc4a79 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 187571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.408374:0:187571:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfd77e6c200 already unused, calling callback (ffffffffc1e434f0) 00010000:00010000:0.0:1777502233.408377:0:187571:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6c200/0x4ad31463d9bc4a79 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 187571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.408381:0:187571:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6c200/0x4ad31463d9bc4a79 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 187571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.408389:0:187571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffff8dfd7f712b00) 00010000:00010000:0.0:1777502233.408396:0:187571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777502233.408399:0:187571:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6c200/0x4ad31463d9bc4a79 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 187571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.408403:0:187571:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6c200/0x4ad31463d9bc4a79 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 187571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.408414:0:187571:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6d000/0x4ad31463d9bc4a80 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.408418:0:187571:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6d000/0x4ad31463d9bc4a80 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.408422:0:187571:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6d000/0x4ad31463d9bc4a80 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.408425:0:187571:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfd77e6d000 already unused, calling callback (ffffffffc1e434f0) 00010000:00010000:0.0:1777502233.408428:0:187571:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6d000/0x4ad31463d9bc4a80 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.408432:0:187571:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6d000/0x4ad31463d9bc4a80 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.408440:0:187571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x7607c0a8 (ffff8dfd7fc41700) 00010000:00010000:0.0:1777502233.408443:0:187571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777502233.408446:0:187571:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6d000/0x4ad31463d9bc4a80 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.408452:0:187571:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6d000/0x4ad31463d9bc4a80 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.408481:0:187571:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6ca00/0x4ad31463d9bc4a72 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xac3ccf43bf834775 expref: 28 pid: 187571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.408513:0:187571:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6cc00/0x4ad31463d9bc4a87 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x219:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xac3ccf43bf834775 expref: 27 pid: 187571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.408520:0:187571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x219:0x0].0x0 (ffff8dfd58bbed00) 00010000:00010000:0.0:1777502233.408523:0:187571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1777502233.408526:0:187571:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dfd77e6cc00, rc 0) 00000100:00100000:0.0:1777502233.408572:0:187571:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfd67668380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4254d622-1c5a-45a0-aa2f-9afde5f83f6d+27:274351:x1863837563158016:12345-192.168.202.27@tcp:101:rm.0 Request processed in 563us (669us total) trans 0 rc 0/0 00000100:00100000:0.0:1777502233.408607:0:187571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3840 00000100:00100000:0.0:1777502233.409758:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1777502233.409803:0:186937:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837563158272 00000100:00100000:2.0:1777502233.409810:0:186937:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837563158272 00000100:00100000:2.0:1777502233.409853:0:186937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3841 00000100:00100000:2.0:1777502233.409864:0:186937:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfc4ddb4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4254d622-1c5a-45a0-aa2f-9afde5f83f6d+27:274351:x1863837563158272:12345-192.168.202.27@tcp:36:rm.0 00010000:00010000:2.0:1777502233.409899:0:186937:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1777502233.409924:0:186937:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6cc00/0x4ad31463d9bc4a87 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x219:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xac3ccf43bf834775 expref: 27 pid: 187571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777502233.409940:0:186937:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x219:0x0].0x0 (ffff8dfd58bbed00) 00010000:00010000:2.0:1777502233.409945:0:186937:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1777502233.409959:0:186937:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd7eec9800/0x4ad31463d9bc4a8e lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 186937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777502233.409969:0:186937:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd7eec9800/0x4ad31463d9bc4a8e lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 186937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777502233.409979:0:186937:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd7eec9800/0x4ad31463d9bc4a8e lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 186937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777502233.409993:0:186937:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd7eec8a00/0x4ad31463d9bc4a95 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 186937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777502233.410001:0:186937:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd7eec8a00/0x4ad31463d9bc4a95 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 186937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777502233.410009:0:186937:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd7eec8a00/0x4ad31463d9bc4a95 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 186937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777502233.410099:0:186937:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd7eec8000/0x4ad31463d9bc4a9c lrc: 3/0,1 mode: --/EX res: [0x200000bd2:0x219:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 186937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777502233.410111:0:186937:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd7226e800/0x4ad31463d9bc4284 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x219:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xac3ccf43bf83462c expref: 39 pid: 186942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777502233.410121:0:186937:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd67665e00/0x4ad31463d9bc4387 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x219:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xac3ccf43bf83469c expref: 39 pid: 186941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777502233.410153:0:186937:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd6b122800/0x4ad31463d9bc43db lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x219:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xac3ccf43bf83466b expref: 39 pid: 186942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777502233.410161:0:186937:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd7eec8000/0x4ad31463d9bc4a9c lrc: 6/0,1 mode: --/EX res: [0x200000bd2:0x219:0x0].0x0 bits 0x3/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 186937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777502233.410191:0:186937:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd6b122800/0x4ad31463d9bc43db lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x219:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xac3ccf43bf83466b expref: 39 pid: 186942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777502233.410214:0:186937:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd6b122800/0x4ad31463d9bc43db lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x219:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xac3ccf43bf83466b expref: 39 pid: 186942 timeout: 8460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777502233.410230:0:186937:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8dfd67668a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:186937:1863837561412864:192.168.202.27@tcp:104: 00010000:00010000:2.0:1777502233.410311:0:186937:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd67665e00/0x4ad31463d9bc4387 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x219:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xac3ccf43bf83469c expref: 39 pid: 186941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777502233.410323:0:186937:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd67665e00/0x4ad31463d9bc4387 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x219:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xac3ccf43bf83469c expref: 39 pid: 186941 timeout: 8460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777502233.410335:0:186937:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8dfd67669500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:186937:1863837561412992:192.168.202.27@tcp:104: 00010000:00010000:2.0:1777502233.410373:0:186937:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd7226e800/0x4ad31463d9bc4284 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x219:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xac3ccf43bf83462c expref: 39 pid: 186942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777502233.410385:0:186937:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd7226e800/0x4ad31463d9bc4284 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x219:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xac3ccf43bf83462c expref: 39 pid: 186942 timeout: 8460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777502233.410408:0:186937:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8dfd67669f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:186937:1863837561413120:192.168.202.27@tcp:104: 00000100:00100000:2.0:1777502233.410444:0:186937:0:(client.c:2691:ptlrpc_set_wait()) set ffff8dfd51ffac00 going to sleep for 11 seconds 00000100:00100000:2.0:1777502233.411178:0:186937:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8dfd67668a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:186937:1863837561412864:192.168.202.27@tcp:104: 00000100:00100000:3.0:1777502233.411395:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1777502233.411415:0:186937:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8dfd67669500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:186937:1863837561412992:192.168.202.27@tcp:104: 00000100:00100000:3.0:1777502233.411469:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1777502233.411486:0:191872:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837563158400 00000100:00100000:0.0:1777502233.411501:0:191872:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837563158400 00000100:00100000:2.0:1777502233.411517:0:205589:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837563158528 00000100:00100000:2.0:1777502233.411521:0:205589:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837563158528 00010000:00010000:0.0:1777502233.411524:0:191872:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd6b122800/0x4ad31463d9bc43db lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x219:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xac3ccf43bf83466b expref: 40 pid: 186942 timeout: 8460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777502233.411552:0:205589:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd67665e00/0x4ad31463d9bc4387 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x219:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xac3ccf43bf83469c expref: 41 pid: 186941 timeout: 8460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777502233.411562:0:191872:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1164 00000100:00100000:0.0:1777502233.411575:0:191872:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfd7c2fca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0775d2ab-558e-41f1-82c0-14244d133390+41:2371:x1863837563158400:12345-192.168.202.27@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1777502233.411611:0:205589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1165 00010000:00010000:0.0:1777502233.411618:0:191872:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1777502233.411619:0:205589:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfd7c2ff480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:0775d2ab-558e-41f1-82c0-14244d133390+41:2371:x1863837563158528:12345-192.168.202.27@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1777502233.411628:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:0.0:1777502233.411629:0:191872:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd6b122800/0x4ad31463d9bc43db lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x219:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xac3ccf43bf83466b expref: 41 pid: 186942 timeout: 8460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777502233.411631:0:205589:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1777502233.411638:0:205589:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd67665e00/0x4ad31463d9bc4387 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x219:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xac3ccf43bf83469c expref: 41 pid: 186941 timeout: 8460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.411650:0:191872:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd6b122800/0x4ad31463d9bc43db lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x219:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xac3ccf43bf83466b expref: 41 pid: 186942 timeout: 8460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777502233.411663:0:205589:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd67665e00/0x4ad31463d9bc4387 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x219:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xac3ccf43bf83469c expref: 41 pid: 186941 timeout: 8460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.411683:0:191872:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd6b122800/0x4ad31463d9bc43db lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x219:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xac3ccf43bf83466b expref: 41 pid: 186942 timeout: 8460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777502233.411687:0:205589:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd67665e00/0x4ad31463d9bc4387 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x219:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xac3ccf43bf83469c expref: 41 pid: 186941 timeout: 8460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777502233.411704:0:205589:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x219:0x0].0x0 (ffff8dfd58bbed00) 00010000:00010000:2.0:1777502233.411708:0:205589:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd7eec8000/0x4ad31463d9bc4a9c lrc: 3/0,1 mode: --/EX res: [0x200000bd2:0x219:0x0].0x0 bits 0x3/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 186937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777502233.411721:0:205589:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd7eec8000/0x4ad31463d9bc4a9c lrc: 3/0,1 mode: --/EX res: [0x200000bd2:0x219:0x0].0x0 bits 0x3/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 186937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777502233.411725:0:205589:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1777502233.411730:0:191872:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x219:0x0].0x0 (ffff8dfd58bbed00) 00010000:00010000:0.0:1777502233.411736:0:191872:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd7eec8000/0x4ad31463d9bc4a9c lrc: 3/0,1 mode: --/EX res: [0x200000bd2:0x219:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 186937 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777502233.411740:0:186923:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837563158656 00000100:00100000:3.0:1777502233.411747:0:186923:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837563158656 00010000:00010000:0.0:1777502233.411751:0:191872:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd7eec8000/0x4ad31463d9bc4a9c lrc: 3/0,1 mode: --/EX res: [0x200000bd2:0x219:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 186937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.411760:0:191872:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1777502233.411761:0:205589:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfd7c2ff480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:0775d2ab-558e-41f1-82c0-14244d133390+40:2371:x1863837563158528:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 141us (291us total) trans 0 rc 0/0 00010000:00010000:3.0:1777502233.411770:0:186923:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd7226e800/0x4ad31463d9bc4284 lrc: 5/0,0 mode: PR/PR res: [0x200000bd2:0x219:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xac3ccf43bf83462c expref: 40 pid: 186942 timeout: 8460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777502233.411773:0:205589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1165 00000100:00100000:0.0:1777502233.411795:0:191872:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfd7c2fca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0775d2ab-558e-41f1-82c0-14244d133390+39:2371:x1863837563158400:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 222us (398us total) trans 0 rc 0/0 00000100:00100000:0.0:1777502233.411805:0:191872:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1164 00000100:00100000:3.0:1777502233.411813:0:186923:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1166 00000100:00100000:3.0:1777502233.411833:0:186923:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfc4f555c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0775d2ab-558e-41f1-82c0-14244d133390+38:2370:x1863837563158656:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1777502233.411843:0:186923:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1777502233.411849:0:186923:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd7226e800/0x4ad31463d9bc4284 lrc: 5/0,0 mode: PR/PR res: [0x200000bd2:0x219:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xac3ccf43bf83462c expref: 38 pid: 186942 timeout: 8460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777502233.411862:0:186937:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8dfd67669f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:186937:1863837561413120:192.168.202.27@tcp:104: 00010000:00010000:3.0:1777502233.411867:0:186923:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd7226e800/0x4ad31463d9bc4284 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x219:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xac3ccf43bf83462c expref: 38 pid: 186942 timeout: 8460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.411884:0:186923:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd7226e800/0x4ad31463d9bc4284 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x219:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xac3ccf43bf83462c expref: 38 pid: 186942 timeout: 8460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777502233.411893:0:186937:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd7eec8000/0x4ad31463d9bc4a9c lrc: 3/0,1 mode: --/EX res: [0x200000bd2:0x219:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 186937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.411895:0:186923:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x219:0x0].0x0 (ffff8dfd58bbed00) 00010000:00010000:3.0:1777502233.411902:0:186923:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd7eec8000/0x4ad31463d9bc4a9c lrc: 3/0,1 mode: --/EX res: [0x200000bd2:0x219:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 186937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.411911:0:186923:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd7eec8000/0x4ad31463d9bc4a9c lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x219:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 186937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.411918:0:186923:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd7eec8000/0x4ad31463d9bc4a9c lrc: 4/0,1 mode: EX/EX res: [0x200000bd2:0x219:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 186937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.411935:0:186923:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1777502233.411941:0:186937:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd7eec8000/0x4ad31463d9bc4a9c lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x219:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 186937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777502233.411948:0:186937:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd7eec8000/0x4ad31463d9bc4a9c lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x219:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 186937 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777502233.412041:0:186923:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfc4f555c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0775d2ab-558e-41f1-82c0-14244d133390+37:2370:x1863837563158656:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 210us (417us total) trans 0 rc 0/0 00000100:00100000:3.0:1777502233.412050:0:186923:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1166 00000040:00080000:2.0:1777502233.412660:0:186937:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].539, 64 off42688 00010000:00010000:2.0:1777502233.412743:0:186937:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd7eec9000/0x4ad31463d9bc4aa3 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x219:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 186937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777502233.412754:0:186937:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd7eec9000/0x4ad31463d9bc4aa3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x219:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 186937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777502233.412761:0:186937:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd7eec9000/0x4ad31463d9bc4aa3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x219:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 186937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777502233.412766:0:186937:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd7eec9000/0x4ad31463d9bc4aa3 lrc: 4/0,1 mode: PW/PW res: [0x200000bd2:0x219:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 186937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777502233.412779:0:186937:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd7eec9000/0x4ad31463d9bc4aa3 lrc: 4/0,1 mode: PW/PW res: [0x200000bd2:0x219:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 186937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777502233.412783:0:186937:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd7eec9000/0x4ad31463d9bc4aa3 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x219:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 186937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777502233.412796:0:186937:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1777502233.412809:0:186925:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1777502233.412811:0:186937:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd7eec8000/0x4ad31463d9bc4a9c lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x219:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 186937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.412817:0:186925:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd7eec9000/0x4ad31463d9bc4aa3 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x219:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x40010480000000 pid: 186937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777502233.412817:0:186937:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd7eec8000/0x4ad31463d9bc4a9c lrc: 2/0,0 mode: EX/EX res: [0x200000bd2:0x219:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 186937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777502233.412833:0:186937:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd7eec8000/0x4ad31463d9bc4a9c lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0x219:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 186937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777502233.412849:0:186937:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfd7eec8000 already unused, calling callback (ffffffffc1e434f0) 00010000:00010000:3.0:1777502233.412850:0:186925:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfd7eec9000 already unused, calling callback (ffffffffc13f52e0) 00010000:00010000:3.0:1777502233.412857:0:186925:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd7eec9000/0x4ad31463d9bc4aa3 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x219:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x40010480000000 pid: 186937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777502233.412857:0:186937:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd7eec8000/0x4ad31463d9bc4a9c lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0x219:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 186937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.412873:0:186925:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd7eec9000/0x4ad31463d9bc4aa3 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x219:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 186937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777502233.412875:0:186937:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd7eec8000/0x4ad31463d9bc4a9c lrc: 4/0,0 mode: EX/EX res: [0x200000bd2:0x219:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 186937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.412889:0:186925:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x219:0x0].0x0 (ffff8dfd58bbed00) 00010000:00010000:3.0:1777502233.412892:0:186925:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1777502233.412895:0:186925:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd7eec9000/0x4ad31463d9bc4aa3 lrc: 1/0,0 mode: --/PW res: [0x200000bd2:0x219:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 186937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.412900:0:186925:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd7eec9000/0x4ad31463d9bc4aa3 lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0x219:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 186937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777502233.412901:0:186937:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x219:0x0].0x0 (ffff8dfd58bbed00) 00010000:00010000:2.0:1777502233.412908:0:186937:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1777502233.412912:0:186937:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd7eec8000/0x4ad31463d9bc4a9c lrc: 2/0,0 mode: --/EX res: [0x200000bd2:0x219:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 186937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.412914:0:186925:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777502233.412918:0:186925:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777502233.412920:0:186937:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd7eec8000/0x4ad31463d9bc4a9c lrc: 0/0,0 mode: --/EX res: [0x200000bd2:0x219:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 186937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.412922:0:186925:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777502233.412946:0:186937:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd7eec9800/0x4ad31463d9bc4a8e lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 186937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777502233.412951:0:186937:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd7eec9800/0x4ad31463d9bc4a8e lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 186937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777502233.412955:0:186937:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd7eec9800/0x4ad31463d9bc4a8e lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 186937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777502233.412959:0:186937:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfd7eec9800 already unused, calling callback (ffffffffc1e434f0) 00010000:00010000:2.0:1777502233.412961:0:186937:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd7eec9800/0x4ad31463d9bc4a8e lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 186937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777502233.412965:0:186937:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd7eec9800/0x4ad31463d9bc4a8e lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 186937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777502233.412972:0:186937:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffff8dfd7f712b00) 00010000:00010000:2.0:1777502233.412973:0:186937:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777502233.412976:0:186937:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd7eec9800/0x4ad31463d9bc4a8e lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 186937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777502233.412980:0:186937:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd7eec9800/0x4ad31463d9bc4a8e lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 186937 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1777502233.412987:0:186937:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000004afda0c7 reply state 000000001d94cb90 transno 8589939079 ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd7eec8a00/0x4ad31463d9bc4a95 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 186937 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777502233.412992:0:186937:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1777502233.413036:0:186937:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfc4ddb4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4254d622-1c5a-45a0-aa2f-9afde5f83f6d+28:274351:x1863837563158272:12345-192.168.202.27@tcp:36:rm.0 Request processed in 3176us (3283us total) trans 8589939079 rc 0/0 00000100:00100000:2.0:1777502233.413043:0:186937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3841 00010000:00010000:3.0:1777502233.413678:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd7eec8a00/0x4ad31463d9bc4a95 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 186937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.413685:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd7eec8a00/0x4ad31463d9bc4a95 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 186937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.413690:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd7eec8a00/0x4ad31463d9bc4a95 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 186937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.413693:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfd7eec8a00 already unused, calling callback (ffffffffc1e434f0) 00010000:00010000:3.0:1777502233.413696:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd7eec8a00/0x4ad31463d9bc4a95 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 186937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.413708:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd7eec8a00/0x4ad31463d9bc4a95 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 186937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.413716:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x7607c0a8 (ffff8dfd80102900) 00010000:00010000:3.0:1777502233.413718:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777502233.413721:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd7eec8a00/0x4ad31463d9bc4a95 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 186937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.413725:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd7eec8a00/0x4ad31463d9bc4a95 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 186937 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777502233.414048:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1777502233.414106:0:188648:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837563158784 00000100:00100000:2.0:1777502233.414117:0:188648:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837563158784 00000100:00100000:2.0:1777502233.414176:0:188648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3842 00000100:00100000:2.0:1777502233.414188:0:188648:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfc4ddb7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4254d622-1c5a-45a0-aa2f-9afde5f83f6d+27:274351:x1863837563158784:12345-192.168.202.27@tcp:101:rm.0 00010000:00010000:2.0:1777502233.414207:0:188648:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777502233.414220:0:188648:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd7eec9c00/0x4ad31463d9bc4aaa lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac3ccf43bf83477c expref: -99 pid: 188648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777502233.414274:0:188648:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd7eec8e00/0x4ad31463d9bc4ab1 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 188648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777502233.414287:0:188648:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd7eec8e00/0x4ad31463d9bc4ab1 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 188648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777502233.414297:0:188648:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd7eec8e00/0x4ad31463d9bc4ab1 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 188648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777502233.414311:0:188648:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd7eec9200/0x4ad31463d9bc4ab8 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x15f74fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777502233.414320:0:188648:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd7eec9200/0x4ad31463d9bc4ab8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777502233.414329:0:188648:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd7eec9200/0x4ad31463d9bc4ab8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777502233.414432:0:188648:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd7eec8c00/0x4ad31463d9bc4abf lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0x210:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 188648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777502233.414442:0:188648:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd7eec8c00/0x4ad31463d9bc4abf lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x210:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777502233.414463:0:188648:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd7eec8c00/0x4ad31463d9bc4abf lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x210:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 188648 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1777502233.414515:0:188648:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd2:0x210:0x0]: returning size 0 00000004:00200000:2.0:1777502233.414519:0:188648:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1777502233.414535:0:188648:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd7eec8c00/0x4ad31463d9bc4abf lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x210:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 188648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777502233.414547:0:188648:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd7eec8c00/0x4ad31463d9bc4abf lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x210:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777502233.414555:0:188648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd7eec8e00/0x4ad31463d9bc4ab1 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 188648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777502233.414563:0:188648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd7eec8e00/0x4ad31463d9bc4ab1 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 188648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777502233.414570:0:188648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd7eec8e00/0x4ad31463d9bc4ab1 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 188648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777502233.414600:0:188648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfd7eec8e00 already unused, calling callback (ffffffffc1e434f0) 00010000:00010000:2.0:1777502233.414604:0:188648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd7eec8e00/0x4ad31463d9bc4ab1 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 188648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777502233.414611:0:188648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd7eec8e00/0x4ad31463d9bc4ab1 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 188648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777502233.414624:0:188648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffff8dfd7f712b00) 00010000:00010000:2.0:1777502233.414627:0:188648:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777502233.414632:0:188648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd7eec8e00/0x4ad31463d9bc4ab1 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 188648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777502233.414652:0:188648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd7eec8e00/0x4ad31463d9bc4ab1 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 188648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777502233.414669:0:188648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd7eec9200/0x4ad31463d9bc4ab8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777502233.414676:0:188648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd7eec9200/0x4ad31463d9bc4ab8 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777502233.414683:0:188648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd7eec9200/0x4ad31463d9bc4ab8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777502233.414689:0:188648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfd7eec9200 already unused, calling callback (ffffffffc1e434f0) 00010000:00010000:2.0:1777502233.414692:0:188648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd7eec9200/0x4ad31463d9bc4ab8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777502233.414700:0:188648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd7eec9200/0x4ad31463d9bc4ab8 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777502233.414712:0:188648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x15f74fa8 (ffff8dfd80102f00) 00010000:00010000:2.0:1777502233.414716:0:188648:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777502233.414720:0:188648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd7eec9200/0x4ad31463d9bc4ab8 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777502233.414727:0:188648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd7eec9200/0x4ad31463d9bc4ab8 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777502233.414768:0:188648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd7eec9c00/0x4ad31463d9bc4aaa lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xac3ccf43bf83477c expref: 29 pid: 188648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777502233.414799:0:188648:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd7eec8c00/0x4ad31463d9bc4abf lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x210:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xac3ccf43bf83477c expref: 28 pid: 188648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777502233.414809:0:188648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x210:0x0].0x0 (ffff8dfd58bbeb00) 00010000:00010000:2.0:1777502233.414812:0:188648:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1777502233.414816:0:188648:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dfd7eec8c00, rc 0) 00000100:00100000:2.0:1777502233.414866:0:188648:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfc4ddb7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4254d622-1c5a-45a0-aa2f-9afde5f83f6d+28:274351:x1863837563158784:12345-192.168.202.27@tcp:101:rm.0 Request processed in 680us (819us total) trans 0 rc 0/0 00000100:00100000:2.0:1777502233.414875:0:188648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3842 00000100:00100000:0.0:1777502233.416103:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1777502233.416160:0:205369:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837563159040 00000100:00100000:3.0:1777502233.416167:0:205369:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837563159040 00000100:00100000:3.0:1777502233.416218:0:205369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3843 00000100:00100000:3.0:1777502233.416229:0:205369:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfc4ddb5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:4254d622-1c5a-45a0-aa2f-9afde5f83f6d+28:274351:x1863837563159040:12345-192.168.202.27@tcp:36:rm.0 00010000:00010000:3.0:1777502233.416271:0:205369:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1777502233.416292:0:205369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd7eec8c00/0x4ad31463d9bc4abf lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x210:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xac3ccf43bf83477c expref: 28 pid: 188648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.416308:0:205369:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x210:0x0].0x0 (ffff8dfd58bbeb00) 00010000:00010000:3.0:1777502233.416313:0:205369:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1777502233.416330:0:205369:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da57800/0x4ad31463d9bc4ac6 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 205369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.416342:0:205369:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da57800/0x4ad31463d9bc4ac6 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 205369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.416352:0:205369:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da57800/0x4ad31463d9bc4ac6 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 205369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.416377:0:205369:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da57200/0x4ad31463d9bc4acd lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x20:0x0].0x15f74fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.416386:0:205369:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da57200/0x4ad31463d9bc4acd lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.416393:0:205369:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da57200/0x4ad31463d9bc4acd lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.416511:0:205369:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da56600/0x4ad31463d9bc4ad4 lrc: 3/0,1 mode: --/EX res: [0x200000bd2:0x210:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 205369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.416523:0:205369:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd6eba6800/0x4ad31463d9bc4007 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x210:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xac3ccf43bf834529 expref: 36 pid: 205369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.416532:0:205369:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da56600/0x4ad31463d9bc4ad4 lrc: 4/0,1 mode: --/EX res: [0x200000bd2:0x210:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 205369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.416564:0:205369:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd6eba6800/0x4ad31463d9bc4007 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x210:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xac3ccf43bf834529 expref: 36 pid: 205369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.416606:0:205369:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd6eba6800/0x4ad31463d9bc4007 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x210:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xac3ccf43bf834529 expref: 36 pid: 205369 timeout: 8460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777502233.416622:0:205369:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8dfd7c2fd500 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:205369:1863837561413248:192.168.202.27@tcp:104: 00000100:00100000:3.0:1777502233.416698:0:205369:0:(client.c:2691:ptlrpc_set_wait()) set ffff8dfc45a256c0 going to sleep for 11 seconds 00000100:00100000:0.0:1777502233.417657:0:205369:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8dfd7c2fd500 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:205369:1863837561413248:192.168.202.27@tcp:104: 00010000:00010000:0.0:1777502233.417676:0:205369:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da56600/0x4ad31463d9bc4ad4 lrc: 3/0,1 mode: --/EX res: [0x200000bd2:0x210:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 205369 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777502233.417920:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1777502233.417965:0:186921:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837563159168 00000100:00100000:2.0:1777502233.417971:0:186921:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837563159168 00010000:00010000:2.0:1777502233.417995:0:186921:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd6eba6800/0x4ad31463d9bc4007 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x210:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xac3ccf43bf834529 expref: 37 pid: 205369 timeout: 8460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777502233.418029:0:186921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1167 00000100:00100000:2.0:1777502233.418044:0:186921:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfc4ddb6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0775d2ab-558e-41f1-82c0-14244d133390+37:2370:x1863837563159168:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1777502233.418056:0:186921:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1777502233.418062:0:186921:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd6eba6800/0x4ad31463d9bc4007 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0x210:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xac3ccf43bf834529 expref: 37 pid: 205369 timeout: 8460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777502233.418077:0:186921:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd6eba6800/0x4ad31463d9bc4007 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x210:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xac3ccf43bf834529 expref: 37 pid: 205369 timeout: 8460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777502233.418097:0:186921:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd6eba6800/0x4ad31463d9bc4007 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x210:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xac3ccf43bf834529 expref: 37 pid: 205369 timeout: 8460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777502233.418136:0:186921:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x210:0x0].0x0 (ffff8dfd58bbeb00) 00010000:00010000:2.0:1777502233.418141:0:186921:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da56600/0x4ad31463d9bc4ad4 lrc: 3/0,1 mode: --/EX res: [0x200000bd2:0x210:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 205369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777502233.418147:0:186921:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da56600/0x4ad31463d9bc4ad4 lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x210:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 205369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777502233.418151:0:186921:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da56600/0x4ad31463d9bc4ad4 lrc: 4/0,1 mode: EX/EX res: [0x200000bd2:0x210:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 205369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777502233.418171:0:186921:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1777502233.418198:0:205369:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da56600/0x4ad31463d9bc4ad4 lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x210:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 205369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.418206:0:205369:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da56600/0x4ad31463d9bc4ad4 lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x210:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 205369 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777502233.418213:0:186921:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfc4ddb6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0775d2ab-558e-41f1-82c0-14244d133390+36:2370:x1863837563159168:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 176us (296us total) trans 0 rc 0/0 00000100:00100000:2.0:1777502233.418221:0:186921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1167 00000040:00080000:0.0:1777502233.418881:0:205369:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].544, 64 off43008 00010000:00010000:0.0:1777502233.418969:0:205369:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6d000/0x4ad31463d9bc4adb lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0x210:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 205369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.418989:0:205369:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6d000/0x4ad31463d9bc4adb lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x210:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 205369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.418998:0:205369:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6d000/0x4ad31463d9bc4adb lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0x210:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 205369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.419007:0:205369:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6d000/0x4ad31463d9bc4adb lrc: 4/0,1 mode: PW/PW res: [0x200000bd2:0x210:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 205369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.419015:0:205369:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6d000/0x4ad31463d9bc4adb lrc: 4/0,1 mode: PW/PW res: [0x200000bd2:0x210:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 205369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.419022:0:205369:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6d000/0x4ad31463d9bc4adb lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x210:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 205369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.419044:0:205369:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1777502233.419061:0:205369:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da56600/0x4ad31463d9bc4ad4 lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0x210:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 205369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.419068:0:205387:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1777502233.419068:0:205369:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da56600/0x4ad31463d9bc4ad4 lrc: 2/0,0 mode: EX/EX res: [0x200000bd2:0x210:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 205369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.419075:0:205387:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6d000/0x4ad31463d9bc4adb lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x210:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x40010480000000 pid: 205369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.419077:0:205369:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da56600/0x4ad31463d9bc4ad4 lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0x210:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 205369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.419089:0:205387:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfd77e6d000 already unused, calling callback (ffffffffc13f52e0) 00010000:00010000:0.0:1777502233.419091:0:205369:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfd4da56600 already unused, calling callback (ffffffffc1e434f0) 00010000:00010000:3.0:1777502233.419094:0:205387:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6d000/0x4ad31463d9bc4adb lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0x210:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 205369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.419096:0:205369:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da56600/0x4ad31463d9bc4ad4 lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0x210:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 205369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.419105:0:205387:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6d000/0x4ad31463d9bc4adb lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0x210:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x40018480000000 pid: 205369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.419108:0:205369:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da56600/0x4ad31463d9bc4ad4 lrc: 4/0,0 mode: EX/EX res: [0x200000bd2:0x210:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 205369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.419118:0:205387:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x210:0x0].0x0 (ffff8dfd58bbeb00) 00010000:00010000:3.0:1777502233.419121:0:205387:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1777502233.419125:0:205387:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6d000/0x4ad31463d9bc4adb lrc: 1/0,0 mode: --/PW res: [0x200000bd2:0x210:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x44819480000000 pid: 205369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.419136:0:205387:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd77e6d000/0x4ad31463d9bc4adb lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0x210:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 205369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.419141:0:205369:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0x210:0x0].0x0 (ffff8dfd58bbeb00) 00010000:00010000:0.0:1777502233.419145:0:205369:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1777502233.419147:0:205387:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777502233.419150:0:205369:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da56600/0x4ad31463d9bc4ad4 lrc: 2/0,0 mode: --/EX res: [0x200000bd2:0x210:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 205369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.419151:0:205387:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777502233.419155:0:205387:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777502233.419160:0:205369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da56600/0x4ad31463d9bc4ad4 lrc: 0/0,0 mode: --/EX res: [0x200000bd2:0x210:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 205369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.419179:0:205369:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da57800/0x4ad31463d9bc4ac6 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 205369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.419186:0:205369:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da57800/0x4ad31463d9bc4ac6 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 205369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.419192:0:205369:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da57800/0x4ad31463d9bc4ac6 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 205369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.419198:0:205369:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfd4da57800 already unused, calling callback (ffffffffc1e434f0) 00010000:00010000:0.0:1777502233.419201:0:205369:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da57800/0x4ad31463d9bc4ac6 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 205369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.419207:0:205369:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da57800/0x4ad31463d9bc4ac6 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 205369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.419216:0:205369:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffff8dfd7f712b00) 00010000:00010000:0.0:1777502233.419219:0:205369:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777502233.419223:0:205369:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da57800/0x4ad31463d9bc4ac6 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 205369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502233.419229:0:205369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da57800/0x4ad31463d9bc4ac6 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 205369 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1777502233.419249:0:205369:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000180a2745 reply state 00000000129c5605 transno 8589939080 ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da57200/0x4ad31463d9bc4acd lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205369 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777502233.419258:0:205369:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1777502233.419313:0:205369:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfc4ddb5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:4254d622-1c5a-45a0-aa2f-9afde5f83f6d+29:274351:x1863837563159040:12345-192.168.202.27@tcp:36:rm.0 Request processed in 3085us (3213us total) trans 8589939080 rc 0/0 00000100:00100000:0.0:1777502233.419321:0:205369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3843 00010000:00010000:3.0:1777502233.419917:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da57200/0x4ad31463d9bc4acd lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.419927:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da57200/0x4ad31463d9bc4acd lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 205369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.419934:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da57200/0x4ad31463d9bc4acd lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.419941:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfd4da57200 already unused, calling callback (ffffffffc1e434f0) 00010000:00010000:3.0:1777502233.419945:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da57200/0x4ad31463d9bc4acd lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.419964:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da57200/0x4ad31463d9bc4acd lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x20:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 205369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.419977:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x15f74fa8 (ffff8dfd47d8b700) 00010000:00010000:3.0:1777502233.419981:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777502233.419998:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da57200/0x4ad31463d9bc4acd lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.420006:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da57200/0x4ad31463d9bc4acd lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x20:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205369 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777502233.420537:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1777502233.420593:0:205362:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837563159424 00000100:00100000:0.0:1777502233.420599:0:205362:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837563159424 00000100:00100000:0.0:1777502233.420636:0:205362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1172 00000100:00100000:0.0:1777502233.420644:0:205362:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfd7c2ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:4254d622-1c5a-45a0-aa2f-9afde5f83f6d+28:274351:x1863837563159424:12345-192.168.202.27@tcp:35:rm.0 00000100:00100000:0.0:1777502233.420807:0:205362:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfd7c2ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:4254d622-1c5a-45a0-aa2f-9afde5f83f6d+29:274351:x1863837563159424:12345-192.168.202.27@tcp:35:rm.0 Request processed in 164us (273us total) trans 8589939081 rc 0/0 00000100:00100000:0.0:1777502233.420813:0:205362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1172 00000100:00100000:0.0:1777502233.421620:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1777502233.421653:0:186936:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837563159680 00000100:00100000:3.0:1777502233.421658:0:186936:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837563159680 00000100:00100000:3.0:1777502233.421697:0:186936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3844 00000100:00100000:3.0:1777502233.421707:0:186936:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfc4a058700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4254d622-1c5a-45a0-aa2f-9afde5f83f6d+29:274351:x1863837563159680:12345-192.168.202.27@tcp:36:rm.0 00010000:00010000:3.0:1777502233.421741:0:186936:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1777502233.421761:0:186936:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd7eec8800/0x4ad31463d9bc4834 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xac3ccf43bf834728 expref: 29 pid: 205372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.421781:0:186936:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd40031a00/0x4ad31463d9ba1015 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xac3ccf43bf82af0b expref: 28 pid: 188648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.421797:0:186936:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffff8dfd7f712b00) 00010000:00010000:3.0:1777502233.421809:0:186936:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd40030400/0x4ad31463d9ba0fd6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xac3ccf43bf82aefd expref: 27 pid: 188648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.421838:0:186936:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dfd7f712100) 00010000:00010000:3.0:1777502233.421842:0:186936:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1777502233.421859:0:186936:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da57400/0x4ad31463d9bc4ae2 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 186936 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.421869:0:186936:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd6b122400/0x4ad31463d9ba1700 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xac3ccf43bf82b10a expref: 35 pid: 205369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.421878:0:186936:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da57400/0x4ad31463d9bc4ae2 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 186936 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.421908:0:186936:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd6b122400/0x4ad31463d9ba1700 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xac3ccf43bf82b10a expref: 35 pid: 205369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.421923:0:186936:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd6b122400/0x4ad31463d9ba1700 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xac3ccf43bf82b10a expref: 35 pid: 205369 timeout: 8460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777502233.421936:0:186936:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8dfd7c2fca80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:186936:1863837561413376:192.168.202.27@tcp:104: 00000100:00100000:3.0:1777502233.421997:0:186936:0:(client.c:2691:ptlrpc_set_wait()) set ffff8dfc45a25600 going to sleep for 11 seconds 00000100:00100000:2.0:1777502233.422847:0:186936:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8dfd7c2fca80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:186936:1863837561413376:192.168.202.27@tcp:104: 00010000:00010000:2.0:1777502233.422871:0:186936:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da57400/0x4ad31463d9bc4ae2 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 186936 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777502233.422955:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1777502233.423010:0:205589:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837563159808 00000100:00100000:2.0:1777502233.423016:0:205589:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837563159808 00010000:00010000:2.0:1777502233.423042:0:205589:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd6b122400/0x4ad31463d9ba1700 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xac3ccf43bf82b10a expref: 36 pid: 205369 timeout: 8460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777502233.423079:0:205589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1168 00000100:00100000:2.0:1777502233.423091:0:205589:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfc4a059c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:0775d2ab-558e-41f1-82c0-14244d133390+36:2370:x1863837563159808:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1777502233.423102:0:205589:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1777502233.423109:0:205589:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd6b122400/0x4ad31463d9ba1700 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xac3ccf43bf82b10a expref: 36 pid: 205369 timeout: 8460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777502233.423130:0:205589:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd6b122400/0x4ad31463d9ba1700 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xac3ccf43bf82b10a expref: 36 pid: 205369 timeout: 8460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777502233.423147:0:205589:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd6b122400/0x4ad31463d9ba1700 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xac3ccf43bf82b10a expref: 36 pid: 205369 timeout: 8460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777502233.423164:0:205589:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dfd7f712100) 00010000:00010000:2.0:1777502233.423169:0:205589:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da57400/0x4ad31463d9bc4ae2 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 186936 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777502233.423177:0:205589:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da57400/0x4ad31463d9bc4ae2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 186936 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777502233.423185:0:205589:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da57400/0x4ad31463d9bc4ae2 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 186936 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777502233.423210:0:205589:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1777502233.423235:0:186936:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da57400/0x4ad31463d9bc4ae2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 186936 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.423245:0:186936:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da57400/0x4ad31463d9bc4ae2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 186936 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777502233.423251:0:205589:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfc4a059c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:0775d2ab-558e-41f1-82c0-14244d133390+35:2370:x1863837563159808:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 162us (294us total) trans 0 rc 0/0 00000100:00100000:2.0:1777502233.423262:0:205589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1168 00010000:00010000:3.0:1777502233.423275:0:186936:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da57c00/0x4ad31463d9bc4ae9 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xac38cf7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 186936 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.423298:0:186936:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da57c00/0x4ad31463d9bc4ae9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xac38cf7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 186936 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.423308:0:186936:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da57c00/0x4ad31463d9bc4ae9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xac38cf7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 186936 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.423689:0:186936:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da56e00/0x4ad31463d9bc4af0 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 186936 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.423699:0:186936:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd43979400/0x4ad31463d9ba1738 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xac3ccf43bf82b12d expref: 34 pid: 186938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.423704:0:186936:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da56e00/0x4ad31463d9bc4af0 lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x20:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 186936 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.423722:0:186936:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd43979400/0x4ad31463d9ba1738 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xac3ccf43bf82b12d expref: 34 pid: 186938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.423732:0:186936:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd43979400/0x4ad31463d9ba1738 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xac3ccf43bf82b12d expref: 34 pid: 186938 timeout: 8460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777502233.423741:0:186936:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8dfd7c2fca80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:186936:1863837561413504:192.168.202.27@tcp:104: 00000100:00100000:3.0:1777502233.423788:0:186936:0:(client.c:2691:ptlrpc_set_wait()) set ffff8dfc45a25600 going to sleep for 11 seconds 00000100:00100000:3.0:1777502233.424564:0:186936:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8dfd7c2fca80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:186936:1863837561413504:192.168.202.27@tcp:104: 00010000:00010000:3.0:1777502233.424669:0:186936:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da56e00/0x4ad31463d9bc4af0 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x20:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 186936 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777502233.424755:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1777502233.424800:0:205389:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837563159936 00000100:00100000:2.0:1777502233.424805:0:205389:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837563159936 00010000:00010000:2.0:1777502233.424826:0:205389:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd43979400/0x4ad31463d9ba1738 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xac3ccf43bf82b12d expref: 35 pid: 186938 timeout: 8460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777502233.424863:0:205389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1169 00000100:00100000:2.0:1777502233.424873:0:205389:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfc4a05a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:0775d2ab-558e-41f1-82c0-14244d133390+35:2370:x1863837563159936:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1777502233.424888:0:205389:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1777502233.424893:0:205389:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd43979400/0x4ad31463d9ba1738 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xac3ccf43bf82b12d expref: 35 pid: 186938 timeout: 8460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777502233.424907:0:205389:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd43979400/0x4ad31463d9ba1738 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xac3ccf43bf82b12d expref: 35 pid: 186938 timeout: 8460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777502233.424924:0:205389:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd43979400/0x4ad31463d9ba1738 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xac3ccf43bf82b12d expref: 35 pid: 186938 timeout: 8460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777502233.424939:0:205389:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffff8dfd7f712b00) 00010000:00010000:2.0:1777502233.424944:0:205389:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da56e00/0x4ad31463d9bc4af0 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x20:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 186936 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777502233.424951:0:205389:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da56e00/0x4ad31463d9bc4af0 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x20:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 186936 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777502233.424955:0:205389:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da56e00/0x4ad31463d9bc4af0 lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x20:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 186936 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777502233.424973:0:205389:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1777502233.424989:0:186936:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da56e00/0x4ad31463d9bc4af0 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x20:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 186936 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777502233.425004:0:205389:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfc4a05a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:0775d2ab-558e-41f1-82c0-14244d133390+34:2370:x1863837563159936:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 133us (250us total) trans 0 rc 0/0 00010000:00010000:3.0:1777502233.425005:0:186936:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da56e00/0x4ad31463d9bc4af0 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x20:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 186936 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777502233.425013:0:205389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1169 00000004:00200000:3.0:1777502233.427024:0:186936:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd1:0x20:0x0]: returning size 7680 00010000:00010000:3.0:1777502233.427042:0:186936:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da56e00/0x4ad31463d9bc4af0 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x20:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 186936 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.427049:0:186936:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da56e00/0x4ad31463d9bc4af0 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x20:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 186936 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.427054:0:186936:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da56e00/0x4ad31463d9bc4af0 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x20:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 186936 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.427059:0:186936:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfd4da56e00 already unused, calling callback (ffffffffc1e434f0) 00010000:00010000:3.0:1777502233.427063:0:186936:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da56e00/0x4ad31463d9bc4af0 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x20:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 186936 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.427068:0:186936:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da56e00/0x4ad31463d9bc4af0 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x20:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 186936 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.427078:0:186936:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x20:0x0].0x0 (ffff8dfd7f712b00) 00010000:00010000:3.0:1777502233.427080:0:186936:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1777502233.427084:0:186936:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da56e00/0x4ad31463d9bc4af0 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x20:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 186936 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.427089:0:186936:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da56e00/0x4ad31463d9bc4af0 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x20:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 186936 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.427117:0:186936:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da57400/0x4ad31463d9bc4ae2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 186936 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.427135:0:186936:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da57400/0x4ad31463d9bc4ae2 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 186936 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.427141:0:186936:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da57400/0x4ad31463d9bc4ae2 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 186936 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.427146:0:186936:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfd4da57400 already unused, calling callback (ffffffffc1e434f0) 00010000:00010000:3.0:1777502233.427150:0:186936:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da57400/0x4ad31463d9bc4ae2 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 186936 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.427156:0:186936:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da57400/0x4ad31463d9bc4ae2 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 186936 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.427166:0:186936:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dfd7f712100) 00010000:00010000:3.0:1777502233.427169:0:186936:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777502233.427173:0:186936:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da57400/0x4ad31463d9bc4ae2 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 186936 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.427178:0:186936:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da57400/0x4ad31463d9bc4ae2 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 186936 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1777502233.427197:0:186936:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000432a1ac6 reply state 00000000b347ef8a transno 8589939082 ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da57c00/0x4ad31463d9bc4ae9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xac38cf7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 186936 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777502233.427206:0:186936:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1777502233.427281:0:186936:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfc4a058700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4254d622-1c5a-45a0-aa2f-9afde5f83f6d+28:274351:x1863837563159680:12345-192.168.202.27@tcp:36:rm.0 Request processed in 5573us (5660us total) trans 8589939082 rc 0/0 00000100:00100000:3.0:1777502233.427291:0:186936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3844 00010000:00010000:3.0:1777502233.428387:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da57c00/0x4ad31463d9bc4ae9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xac38cf7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 186936 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.428408:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da57c00/0x4ad31463d9bc4ae9 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xac38cf7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 186936 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.428415:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da57c00/0x4ad31463d9bc4ae9 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xac38cf7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 186936 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.428420:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfd4da57c00 already unused, calling callback (ffffffffc1e434f0) 00010000:00010000:3.0:1777502233.428425:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da57c00/0x4ad31463d9bc4ae9 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xac38cf7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 186936 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.428431:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da57c00/0x4ad31463d9bc4ae9 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xac38cf7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 186936 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.428442:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xac38cf7d (ffff8dfd47d8b400) 00010000:00010000:3.0:1777502233.428446:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777502233.428449:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da57c00/0x4ad31463d9bc4ae9 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xac38cf7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 186936 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502233.428455:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da57c00/0x4ad31463d9bc4ae9 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xac38cf7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 186936 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777502233.681901:0:3312:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8dfd67669f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1863837561413632:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1777502233.681967:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777502233.682004:0:3312:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8dfd6ea52680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3312:1863837561414272:0@lo:400:kworker.0 00000100:00100000:2.0:1777502233.682019:0:187552:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837561413632 00000100:00100000:2.0:1777502233.682028:0:187552:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837561413632 00000100:00100000:3.0:1777502233.682034:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777502233.682066:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1777502233.682075:0:3312:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8dfd7c2fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1863837561413760:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1777502233.682101:0:187552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1777502233.682104:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777502233.682117:0:187552:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfd7c2fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1863837561413632:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1777502233.682133:0:3312:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8dfd6766ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1863837561414144:0@lo:400:kworker.0 00000100:00100000:0.0:1777502233.682153:0:187553:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837561413760 00000100:00100000:0.0:1777502233.682159:0:187553:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837561413760 00000100:00100000:3.0:1777502233.682164:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:2.0:1777502233.682177:0:187552:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42008576 pending 0 free 3845128192 avail 3843031040 00000100:00100000:0.0:1777502233.682197:0:187553:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1777502233.682206:0:187553:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfd7c2fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1863837561413760:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1777502233.682217:0:205380:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837561414144 00000100:00100000:3.0:1777502233.682221:0:205380:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837561414144 00002000:00000024:0.0:1777502233.682230:0:187553:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42008576 pending 0 free 3821010944 avail 3818913792 00000100:00100000:2.0:1777502233.682240:0:187552:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfd7c2fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1863837561413632:12345-0@lo:13:osp-pre-0-0.0 Request processed in 126us (270us total) trans 0 rc 0/0 00000100:00100000:2.0:1777502233.682248:0:187552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1777502233.682260:0:205380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:3.0:1777502233.682269:0:205380:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfc4d4a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+6:3312:x1863837561414144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777502233.682274:0:187553:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfd7c2fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3312:x1863837561413760:12345-0@lo:13:osp-pre-1-0.0 Request processed in 70us (173us total) trans 0 rc 0/0 00000100:00080000:2.0:1777502233.682279:0:186932:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1777502233.682283:0:187553:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00080000:2.0:1777502233.682285:0:186932:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1777502233.682309:0:205380:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfc4d4a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+5:3312:x1863837561414144:12345-0@lo:400:kworker.0 Request processed in 39us (142us total) trans 0 rc 0/0 00000100:00100000:0.0:1777502233.682314:0:205372:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837561414272 00000100:00100000:3.0:1777502233.682316:0:205380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:0.0:1777502233.682323:0:205372:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837561414272 00000100:00100000:0.0:1777502233.682360:0:205372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:0.0:1777502233.682372:0:205372:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfd7c2ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1863837561414272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777502233.682416:0:205372:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfd7c2ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1863837561414272:12345-0@lo:400:kworker.0 Request processed in 49us (383us total) trans 0 rc 0/0 00000100:00100000:3.0:1777502233.682423:0:3312:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8dfd7c2fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1863837561413760:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1777502233.682423:0:205372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:3.0:1777502233.682437:0:3312:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8dfd6766ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1863837561414144:0@lo:400:kworker.0 00000100:00100000:0.0:1777502233.682446:0:3310:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8dfd67668a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1863837561414016:0@lo:400:kworker.0 00000100:00100000:3.0:1777502233.682453:0:3312:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8dfd67669f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1863837561413632:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1777502233.682465:0:3312:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8dfd6ea52680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3312:1863837561414272:0@lo:400:kworker.0 00000100:00100000:0.0:1777502233.682476:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777502233.682514:0:3310:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8dfd6ea50000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3310:1863837561414528:0@lo:400:kworker.0 00000100:00100000:2.0:1777502233.682529:0:205384:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837561414016 00000100:00100000:2.0:1777502233.682534:0:205384:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837561414016 00000100:00100000:3.0:1777502233.682539:0:3309:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8dfd67669500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d37a34a7-24bb-490e-b7a8-76d369c5604f:3309:1863837561413888:0@lo:400:kworker.0 00000100:00100000:0.0:1777502233.682543:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777502233.682573:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777502233.682599:0:205384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:2.0:1777502233.682611:0:205384:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfc48234380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+5:3310:x1863837561414016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777502233.682632:0:3309:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8dfd6ea50380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3309:1863837561414400:0@lo:400:kworker.0 00000100:00100000:3.0:1777502233.682668:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777502233.682670:0:205384:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfc48234380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+5:3310:x1863837561414016:12345-0@lo:400:kworker.0 Request processed in 59us (189us total) trans 0 rc 0/0 00000100:00100000:2.0:1777502233.682677:0:205384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:0.0:1777502233.682703:0:187571:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837561414528 00000100:00100000:0.0:1777502233.682708:0:187571:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837561414528 00000100:00100000:3.0:1777502233.682713:0:186929:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837561413888 00000100:00100000:3.0:1777502233.682716:0:186929:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837561413888 00000100:00100000:0.0:1777502233.682743:0:187571:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837561414400 00000100:00100000:3.0:1777502233.682746:0:186929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:0.0:1777502233.682746:0:187571:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837561414400 00000100:00100000:2.0:1777502233.682750:0:3310:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8dfd67668a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1863837561414016:0@lo:400:kworker.0 00000100:00100000:3.0:1777502233.682757:0:186929:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfd7ee1f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d37a34a7-24bb-490e-b7a8-76d369c5604f+18:3309:x1863837561413888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777502233.682779:0:187571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:2.0:1777502233.682788:0:186937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:0.0:1777502233.682790:0:187571:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfc49cdce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1863837561414528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777502233.682798:0:186929:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfd7ee1f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d37a34a7-24bb-490e-b7a8-76d369c5604f+18:3309:x1863837561413888:12345-0@lo:400:kworker.0 Request processed in 44us (227us total) trans 0 rc 0/0 00000100:00100000:2.0:1777502233.682801:0:186937:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfc4d4a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1863837561414400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777502233.682813:0:186929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:0.0:1777502233.682832:0:187571:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfc49cdce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1863837561414528:12345-0@lo:400:kworker.0 Request processed in 47us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1777502233.682840:0:187571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:2.0:1777502233.682854:0:186937:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfc4d4a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1863837561414400:12345-0@lo:400:kworker.0 Request processed in 57us (188us total) trans 0 rc 0/0 00000100:00100000:2.0:1777502233.682862:0:186937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00080000:0.0:1777502233.682865:0:186932:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1777502233.682874:0:3309:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8dfd67669500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d37a34a7-24bb-490e-b7a8-76d369c5604f:3309:1863837561413888:0@lo:400:kworker.0 00000100:00100000:3.0:1777502233.682889:0:3309:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8dfd6ea50380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3309:1863837561414400:0@lo:400:kworker.0 00000100:00100000:2.0:1777502233.682912:0:3310:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8dfd6ea50000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3310:1863837561414528:0@lo:400:kworker.0 00010000:00010000:2.0:1777502234.066732:0:188362:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777502235.089753:0:186924:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777502236.113744:0:186925:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1777502236.985050:0:209505:0:(debug.c:645:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanityn test 77s: Check TBF LRU shrinker ============== 18:37:15 (1777502235) 00000100:00100000:0.0:1777502237.018554:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1777502237.018689:0:188648:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837563160064 00000100:00100000:3.0:1777502237.018699:0:188648:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837563160064 00000100:00100000:3.0:1777502237.018798:0:188648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3845 00000100:00100000:3.0:1777502237.018811:0:188648:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfc49cdd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4254d622-1c5a-45a0-aa2f-9afde5f83f6d+27:274636:x1863837563160064:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1777502237.018833:0:188648:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777502237.018855:0:188648:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da56e00/0x4ad31463d9bc4af7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac3ccf43bf834783 expref: -99 pid: 188648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502237.018913:0:188648:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da57a00/0x4ad31463d9bc4afe lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502237.018928:0:188648:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da57a00/0x4ad31463d9bc4afe lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502237.018942:0:188648:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da57a00/0x4ad31463d9bc4afe lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188648 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1777502237.019008:0:188648:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 71168 00000004:00200000:3.0:1777502237.019012:0:188648:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 82 stripe count 1 MDT count 1 00000004:00010000:3.0:1777502237.019039:0:188648:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da57a00/0x4ad31463d9bc4afe lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502237.019064:0:188648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da56e00/0x4ad31463d9bc4af7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xac3ccf43bf834783 expref: 29 pid: 188648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502237.019095:0:188648:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da57a00/0x4ad31463d9bc4afe lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xac3ccf43bf834783 expref: 28 pid: 188648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502237.019104:0:188648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dfd47d8b700) 00010000:00010000:3.0:1777502237.019108:0:188648:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1777502237.019112:0:188648:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dfd4da57a00, rc 0) 00000100:00100000:3.0:1777502237.019163:0:188648:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfc49cdd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4254d622-1c5a-45a0-aa2f-9afde5f83f6d+28:274636:x1863837563160064:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 356us (618us total) trans 0 rc 0/0 00000100:00100000:3.0:1777502237.019172:0:188648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3845 00000100:00080000:0.0:1777502237.022048:0:186932:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1777502237.025625:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1777502237.025677:0:186936:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837563160192 00000100:00100000:3.0:1777502237.025686:0:186936:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837563160192 00000100:00100000:3.0:1777502237.025743:0:186936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3846 00000100:00100000:3.0:1777502237.025754:0:186936:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfc49cdd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4254d622-1c5a-45a0-aa2f-9afde5f83f6d+28:274636:x1863837563160192:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1777502237.025771:0:186936:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777502237.025800:0:186936:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da56200/0x4ad31463d9bc4b05 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac3ccf43bf83478a expref: -99 pid: 186936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502237.025855:0:186936:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da56c00/0x4ad31463d9bc4b0c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 186936 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502237.025868:0:186936:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da56c00/0x4ad31463d9bc4b0c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 186936 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502237.025879:0:186936:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da56c00/0x4ad31463d9bc4b0c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 186936 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502237.025893:0:186936:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da56400/0x4ad31463d9bc4b13 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x42ba845f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 186936 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502237.025906:0:186936:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da56400/0x4ad31463d9bc4b13 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x42ba845f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 186936 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502237.025914:0:186936:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da56400/0x4ad31463d9bc4b13 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x42ba845f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 186936 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502237.026075:0:186936:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da56c00/0x4ad31463d9bc4b0c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 186936 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502237.026083:0:186936:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da56c00/0x4ad31463d9bc4b0c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 186936 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502237.026090:0:186936:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da56c00/0x4ad31463d9bc4b0c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 186936 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502237.026096:0:186936:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfd4da56c00 already unused, calling callback (ffffffffc1e434f0) 00010000:00010000:3.0:1777502237.026100:0:186936:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da56c00/0x4ad31463d9bc4b0c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 186936 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502237.026107:0:186936:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da56c00/0x4ad31463d9bc4b0c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 186936 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502237.026119:0:186936:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dfd47d8b700) 00010000:00010000:3.0:1777502237.026122:0:186936:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777502237.026127:0:186936:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da56c00/0x4ad31463d9bc4b0c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 186936 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502237.026133:0:186936:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da56c00/0x4ad31463d9bc4b0c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 186936 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502237.026143:0:186936:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da56400/0x4ad31463d9bc4b13 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x42ba845f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 186936 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502237.026154:0:186936:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da56400/0x4ad31463d9bc4b13 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x42ba845f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 186936 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502237.026160:0:186936:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da56400/0x4ad31463d9bc4b13 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x42ba845f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 186936 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502237.026166:0:186936:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfd4da56400 already unused, calling callback (ffffffffc1e434f0) 00010000:00010000:3.0:1777502237.026170:0:186936:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da56400/0x4ad31463d9bc4b13 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x42ba845f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 186936 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502237.026176:0:186936:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da56400/0x4ad31463d9bc4b13 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x42ba845f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 186936 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502237.026186:0:186936:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x42ba845f (ffff8dfd47d8b500) 00010000:00010000:3.0:1777502237.026189:0:186936:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777502237.026192:0:186936:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da56400/0x4ad31463d9bc4b13 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x42ba845f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 186936 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502237.026198:0:186936:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da56400/0x4ad31463d9bc4b13 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x42ba845f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 186936 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502237.026232:0:186936:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da56200/0x4ad31463d9bc4b05 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xac3ccf43bf83478a expref: 29 pid: 186936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502237.026243:0:186936:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dfd47d8b700) 00010000:00010000:3.0:1777502237.026246:0:186936:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777502237.026250:0:186936:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da56200/0x4ad31463d9bc4b05 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.27@tcp remote: 0xac3ccf43bf83478a expref: 29 pid: 186936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502237.026272:0:186936:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dfd4da56200, rc 0) 00000100:00100000:3.0:1777502237.026333:0:186936:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfc49cdd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4254d622-1c5a-45a0-aa2f-9afde5f83f6d+28:274636:x1863837563160192:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 580us (715us total) trans 0 rc 301/301 00000100:00100000:3.0:1777502237.026342:0:186936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3846 00000100:00100000:3.0:1777502237.030377:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1777502237.030494:0:205369:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837563160448 00000100:00100000:0.0:1777502237.030504:0:205369:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837563160448 00000100:00100000:0.0:1777502237.030567:0:205369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3847 00000100:00100000:0.0:1777502237.030601:0:205369:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfd67669500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:4254d622-1c5a-45a0-aa2f-9afde5f83f6d+28:274636:x1863837563160448:12345-192.168.202.27@tcp:36:lfs.0 00010000:00010000:0.0:1777502237.030657:0:205369:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1777502237.030682:0:205369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd4da57a00/0x4ad31463d9bc4afe lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xac3ccf43bf834783 expref: 28 pid: 188648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502237.030699:0:205369:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dfd47d8b700) 00010000:00010000:0.0:1777502237.030712:0:205369:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1777502237.030800:0:205369:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd40030a00/0x4ad31463d9bc4b1a lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502237.030812:0:205369:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd40030a00/0x4ad31463d9bc4b1a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502237.030824:0:205369:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd40030a00/0x4ad31463d9bc4b1a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502237.030838:0:205369:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd40031400/0x4ad31463d9bc4b21 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x42ba845f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502237.030845:0:205369:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd40031400/0x4ad31463d9bc4b21 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x42ba845f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502237.030850:0:205369:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd40031400/0x4ad31463d9bc4b21 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x42ba845f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205369 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1777502237.031548:0:205369:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd1:0x23d:0x0]: returning size 512 00010000:00010000:0.0:1777502237.031558:0:205369:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd40030a00/0x4ad31463d9bc4b1a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502237.031564:0:205369:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd40030a00/0x4ad31463d9bc4b1a lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 205369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502237.031671:0:205369:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd40030a00/0x4ad31463d9bc4b1a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502237.031679:0:205369:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfd40030a00 already unused, calling callback (ffffffffc1e434f0) 00010000:00010000:0.0:1777502237.031683:0:205369:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd40030a00/0x4ad31463d9bc4b1a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502237.031690:0:205369:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd40030a00/0x4ad31463d9bc4b1a lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 205369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502237.031700:0:205369:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dfd7fc41700) 00010000:00010000:0.0:1777502237.031703:0:205369:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777502237.031706:0:205369:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd40030a00/0x4ad31463d9bc4b1a lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502237.031713:0:205369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd40030a00/0x4ad31463d9bc4b1a lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205369 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1777502237.031732:0:205369:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000cccef0a6 reply state 00000000e7278431 transno 8589939083 ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd40031400/0x4ad31463d9bc4b21 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x42ba845f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205369 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777502237.031740:0:205369:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1777502237.031860:0:205369:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfd67669500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:4254d622-1c5a-45a0-aa2f-9afde5f83f6d+29:274636:x1863837563160448:12345-192.168.202.27@tcp:36:lfs.0 Request processed in 1284us (1491us total) trans 8589939083 rc 0/0 00000100:00100000:0.0:1777502237.031868:0:205369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3847 00010000:00010000:3.0:1777502237.033770:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd40031400/0x4ad31463d9bc4b21 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x42ba845f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502237.033781:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd40031400/0x4ad31463d9bc4b21 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x42ba845f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 205369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502237.033797:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd40031400/0x4ad31463d9bc4b21 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x42ba845f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502237.033804:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfd40031400 already unused, calling callback (ffffffffc1e434f0) 00010000:00010000:3.0:1777502237.033808:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd40031400/0x4ad31463d9bc4b21 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x42ba845f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502237.033816:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd40031400/0x4ad31463d9bc4b21 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x42ba845f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 205369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502237.033830:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x42ba845f (ffff8dfd7fc41c00) 00010000:00010000:3.0:1777502237.033833:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777502237.033837:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd40031400/0x4ad31463d9bc4b21 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x42ba845f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502237.033844:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dfd40031400/0x4ad31463d9bc4b21 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x42ba845f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502237.137687:0:205387:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1777502237.341528:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1777502237.341617:0:188648:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837563160704 00000100:00100000:0.0:1777502237.341620:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1777502237.341629:0:188648:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837563160704 00000100:00100000:0.0:1777502237.341653:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1777502237.341690:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1777502237.341695:0:188648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 217 00000100:00100000:2.0:1777502237.341711:0:188648:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfc49cde300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4254d622-1c5a-45a0-aa2f-9afde5f83f6d+28:2370:x1863837563160704:12345-192.168.202.27@tcp:400:kworker.0 00000100:00100000:0.0:1777502237.341731:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1777502237.341766:0:186930:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837563160576 00000100:00100000:0.0:1777502237.341771:0:186930:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837563160576 00000100:00100000:2.0:1777502237.341807:0:188648:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfc49cde300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4254d622-1c5a-45a0-aa2f-9afde5f83f6d+28:2370:x1863837563160704:12345-192.168.202.27@tcp:400:kworker.0 Request processed in 98us (283us total) trans 0 rc 0/0 00000100:00100000:0.0:1777502237.341816:0:186930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 269 00000100:00100000:2.0:1777502237.341819:0:188648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 217 00000100:00100000:0.0:1777502237.341829:0:186930:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfd7ee1cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c3865704-aa9b-444e-8420-b5af90b3c217+12:2371:x1863837563160576:12345-192.168.202.27@tcp:400:kworker.0 00000100:00100000:2.0:1777502237.341845:0:188648:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837563160832 00000100:00100000:2.0:1777502237.341850:0:188648:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837563160832 00000100:00100000:0.0:1777502237.341858:0:186930:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfd7ee1cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c3865704-aa9b-444e-8420-b5af90b3c217+12:2371:x1863837563160576:12345-192.168.202.27@tcp:400:kworker.0 Request processed in 33us (240us total) trans 0 rc 0/0 00000100:00100000:0.0:1777502237.341864:0:186930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 269 00000100:00100000:0.0:1777502237.341899:0:205382:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837563160960 00000100:00100000:2.0:1777502237.341900:0:188648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 218 00000100:00100000:0.0:1777502237.341903:0:205382:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837563160960 00000100:00100000:2.0:1777502237.341914:0:188648:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfc49cdd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0775d2ab-558e-41f1-82c0-14244d133390+34:2371:x1863837563160832:12345-192.168.202.27@tcp:400:kworker.0 00000100:00100000:0.0:1777502237.341936:0:205382:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837563161088 00000100:00100000:0.0:1777502237.341938:0:205382:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837563161088 00000100:00100000:2.0:1777502237.341954:0:188648:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfc49cdd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0775d2ab-558e-41f1-82c0-14244d133390+34:2371:x1863837563160832:12345-192.168.202.27@tcp:400:kworker.0 Request processed in 43us (262us total) trans 0 rc 0/0 00000100:00100000:2.0:1777502237.341964:0:188648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 218 00000100:00100000:0.0:1777502237.341968:0:205382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 253 00000100:00100000:0.0:1777502237.341976:0:205382:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfc49cddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:0775d2ab-558e-41f1-82c0-14244d133390+11:2370:x1863837563160960:12345-192.168.202.27@tcp:400:kworker.0 00000100:00100000:0.0:1777502237.342003:0:205382:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfc49cddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:0775d2ab-558e-41f1-82c0-14244d133390+11:2370:x1863837563160960:12345-192.168.202.27@tcp:400:kworker.0 Request processed in 29us (351us total) trans 0 rc 0/0 00000100:00100000:2.0:1777502237.342009:0:205386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 254 00000100:00100000:0.0:1777502237.342017:0:205382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 253 00000100:00100000:2.0:1777502237.342023:0:205386:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfd4772d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:0775d2ab-558e-41f1-82c0-14244d133390+11:2371:x1863837563161088:12345-192.168.202.27@tcp:400:kworker.0 00000100:00080000:0.0:1777502237.342048:0:186932:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1777502237.342053:0:186932:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1777502237.342057:0:186932:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1777502237.342064:0:205386:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfd4772d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:0775d2ab-558e-41f1-82c0-14244d133390+11:2371:x1863837563161088:12345-192.168.202.27@tcp:400:kworker.0 Request processed in 45us (331us total) trans 0 rc 0/0 00000100:00100000:2.0:1777502237.342072:0:205386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 254 00000001:00080000:0.0:1777502237.810235:0:5817:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 8589939083 is committed 00000004:00080000:0.0:1777502237.810306:0:5817:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 27 committed 00000004:00080000:0.0:1777502237.810336:0:5817:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 31 committed 00000100:00100000:3.0:1777502237.810561:0:3311:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8dfd6ea50000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1863837561414656:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1777502237.810720:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777502237.810729:0:3312:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8dfd4f66b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1863837561414784:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1777502237.810838:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777502237.810882:0:205383:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837561414656 00000100:00100000:0.0:1777502237.810893:0:205383:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837561414656 00000100:00100000:3.0:1777502237.810916:0:205375:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837561414784 00000100:00100000:3.0:1777502237.810924:0:205375:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837561414784 00000100:00100000:0.0:1777502237.811007:0:205383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3373 00000100:00100000:3.0:1777502237.811021:0:205375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3374 00000100:00100000:0.0:1777502237.811026:0:205383:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfd67668a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+5:3311:x1863837561414656:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1777502237.811040:0:205375:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfd6ea50380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3312:x1863837561414784:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1777502237.811062:0:205375:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:4253 count 1 00002000:00080000:0.0:1777502237.811062:0:205383:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:4220 count 1 00010000:00010000:3.0:1777502237.811097:0:205375:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b4fa0c97/0x4ad31463d9bc4b28 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x109d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 205375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502237.811097:0:205383:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003bac8fa2/0x4ad31463d9bc4b2f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x107c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 205383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502237.811137:0:205375:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003f5cac0e/0x4ad31463d9bc446e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x109d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xac3ccf43bf8346c6 expref: 10 pid: 205384 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502237.811137:0:205383:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b8c1dc4b/0x4ad31463d9bc44a6 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x107c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xac3ccf43bf8346e2 expref: 10 pid: 188366 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502237.811163:0:205375:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777502237.811163:0:205383:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777502237.811167:0:205375:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777502237.811169:0:205383:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777502237.811172:0:205375:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b4fa0c97/0x4ad31463d9bc4b28 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x109d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 205375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502237.811172:0:205383:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003bac8fa2/0x4ad31463d9bc4b2f lrc: 4/0,1 mode: --/PW res: [0x280000400:0x107c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 205383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502237.811221:0:205383:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b8c1dc4b/0x4ad31463d9bc44a6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x107c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.27@tcp remote: 0xac3ccf43bf8346e2 expref: 10 pid: 188366 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502237.811224:0:205375:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000003f5cac0e/0x4ad31463d9bc446e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x109d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.27@tcp remote: 0xac3ccf43bf8346c6 expref: 10 pid: 205384 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502237.811249:0:205383:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b8c1dc4b/0x4ad31463d9bc44a6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x107c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.27@tcp remote: 0xac3ccf43bf8346e2 expref: 10 pid: 188366 timeout: 8465 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502237.811250:0:205375:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000003f5cac0e/0x4ad31463d9bc446e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x109d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.27@tcp remote: 0xac3ccf43bf8346c6 expref: 10 pid: 205384 timeout: 8465 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777502237.811281:0:205383:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8dfd4f668380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_015:lustre-OST0001_UUID:205383:1863837561414912:192.168.202.27@tcp:104: 00000100:00100000:3.0:1777502237.811283:0:205375:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8dfd67669f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:205375:1863837561415040:192.168.202.27@tcp:104: 00000100:00100000:0.0:1777502237.811394:0:205383:0:(client.c:2691:ptlrpc_set_wait()) set ffff8dfd50441f00 going to sleep for 11 seconds 00000100:00100000:3.0:1777502237.811395:0:205375:0:(client.c:2691:ptlrpc_set_wait()) set ffff8dfc4e0d7240 going to sleep for 11 seconds 00000100:00080000:0.0:1777502237.811423:0:186932:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1777502237.811430:0:186932:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1777502237.812856:0:205375:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8dfd67669f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:205375:1863837561415040:192.168.202.27@tcp:104: 00010000:00010000:3.0:1777502237.812897:0:205375:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b4fa0c97/0x4ad31463d9bc4b28 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x109d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 205375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777502237.812909:0:205383:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8dfd4f668380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_015:lustre-OST0001_UUID:205383:1863837561414912:192.168.202.27@tcp:104: 00010000:00010000:0.0:1777502237.812936:0:205383:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000003bac8fa2/0x4ad31463d9bc4b2f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x107c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 205383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777502237.813210:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1777502237.813288:0:186922:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837563161344 00000100:00100000:0.0:1777502237.813297:0:186922:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837563161344 00000100:00100000:2.0:1777502237.813332:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:0.0:1777502237.813338:0:186922:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000003f5cac0e/0x4ad31463d9bc446e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x109d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.27@tcp remote: 0xac3ccf43bf8346c6 expref: 11 pid: 205384 timeout: 8465 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777502237.813379:0:186922:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837563161216 00000100:00100000:0.0:1777502237.813382:0:186922:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837563161216 00010000:00010000:0.0:1777502237.813397:0:186922:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b8c1dc4b/0x4ad31463d9bc44a6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x107c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.27@tcp remote: 0xac3ccf43bf8346e2 expref: 11 pid: 188366 timeout: 8465 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777502237.813432:0:186922:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1170 00000100:00100000:0.0:1777502237.813456:0:186922:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfd6ea52680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0775d2ab-558e-41f1-82c0-14244d133390+11:2371:x1863837563161344:12345-192.168.202.27@tcp:103: 00000100:00100000:3.0:1777502237.813459:0:186923:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1171 00010000:00010000:0.0:1777502237.813475:0:186922:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1777502237.813480:0:186923:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfd45955500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0775d2ab-558e-41f1-82c0-14244d133390+11:2370:x1863837563161216:12345-192.168.202.27@tcp:103: 00010000:00010000:0.0:1777502237.813481:0:186922:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000003f5cac0e/0x4ad31463d9bc446e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x109d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.27@tcp remote: 0xac3ccf43bf8346c6 expref: 11 pid: 205384 timeout: 8465 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502237.813499:0:186923:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1777502237.813501:0:186922:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000003f5cac0e/0x4ad31463d9bc446e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x109d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.27@tcp remote: 0xac3ccf43bf8346c6 expref: 11 pid: 205384 timeout: 8465 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502237.813509:0:186923:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b8c1dc4b/0x4ad31463d9bc44a6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x107c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.27@tcp remote: 0xac3ccf43bf8346e2 expref: 11 pid: 188366 timeout: 8465 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502237.813531:0:186923:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b8c1dc4b/0x4ad31463d9bc44a6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x107c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.27@tcp remote: 0xac3ccf43bf8346e2 expref: 11 pid: 188366 timeout: 8465 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502237.813551:0:186922:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003f5cac0e/0x4ad31463d9bc446e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x109d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.27@tcp remote: 0xac3ccf43bf8346c6 expref: 11 pid: 205384 timeout: 8465 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502237.813560:0:186923:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b8c1dc4b/0x4ad31463d9bc44a6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x107c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.27@tcp remote: 0xac3ccf43bf8346e2 expref: 11 pid: 188366 timeout: 8465 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502237.813615:0:186923:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777502237.813619:0:186923:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777502237.813621:0:186922:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777502237.813625:0:186923:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003bac8fa2/0x4ad31463d9bc4b2f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x107c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 205383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502237.813626:0:186922:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777502237.813632:0:186922:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b4fa0c97/0x4ad31463d9bc4b28 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x109d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 205375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502237.813640:0:186923:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003bac8fa2/0x4ad31463d9bc4b2f lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x107c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 205383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502237.813645:0:186922:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b4fa0c97/0x4ad31463d9bc4b28 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x109d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 205375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502237.813706:0:186923:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1777502237.813714:0:186922:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1777502237.813776:0:186923:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfd45955500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0775d2ab-558e-41f1-82c0-14244d133390+10:2370:x1863837563161216:12345-192.168.202.27@tcp:103: Request processed in 297us (443us total) trans 0 rc 0/0 00000100:00100000:0.0:1777502237.813777:0:186922:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfd6ea52680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0775d2ab-558e-41f1-82c0-14244d133390+10:2371:x1863837563161344:12345-192.168.202.27@tcp:103: Request processed in 330us (569us total) trans 0 rc 0/0 00000100:00100000:3.0:1777502237.813796:0:186923:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1171 00000100:00100000:0.0:1777502237.813805:0:186922:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1170 00010000:00010000:3.0:1777502237.813897:0:205375:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b4fa0c97/0x4ad31463d9bc4b28 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x109d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 205375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502237.813908:0:205375:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b4fa0c97/0x4ad31463d9bc4b28 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x109d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 205375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502237.813920:0:205375:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b4fa0c97/0x4ad31463d9bc4b28 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x109d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 205375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502237.813930:0:205375:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b4fa0c97/0x4ad31463d9bc4b28 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x109d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 205375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502237.813957:0:205375:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1777502237.815161:0:205375:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfd6ea50380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+6:3312:x1863837561414784:12345-0@lo:6:osp-syn-0-0.0 Request processed in 4124us (4326us total) trans 8589936162 rc 0/0 00000100:00100000:3.0:1777502237.815175:0:205375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3374 00010000:00010000:3.0:1777502237.815215:0:188362:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1777502237.815224:0:188362:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b4fa0c97/0x4ad31463d9bc4b28 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x109d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 205375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502237.815235:0:188362:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfd4da56200 already unused, calling callback (ffffffffc13f52e0) 00010000:00010000:3.0:1777502237.815248:0:188362:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b4fa0c97/0x4ad31463d9bc4b28 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x109d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 205375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502237.815260:0:188362:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b4fa0c97/0x4ad31463d9bc4b28 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x109d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 205375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502237.815282:0:188362:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b4fa0c97/0x4ad31463d9bc4b28 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x109d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 205375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502237.815290:0:188362:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b4fa0c97/0x4ad31463d9bc4b28 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x109d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 205375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502237.815325:0:188362:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777502237.815331:0:188362:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777502237.815337:0:188362:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1777502237.815387:0:3312:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8dfd4f66b800/2, rc 0, transno 8589936162 00000100:00100000:3.0:1777502237.815416:0:3312:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8dfd4f66b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1863837561414784:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1777502237.815688:0:205383:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000003bac8fa2/0x4ad31463d9bc4b2f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x107c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 205383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502237.815699:0:205383:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003bac8fa2/0x4ad31463d9bc4b2f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x107c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 205383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502237.815709:0:205383:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003bac8fa2/0x4ad31463d9bc4b2f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x107c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 205383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502237.815718:0:205383:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003bac8fa2/0x4ad31463d9bc4b2f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x107c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 205383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502237.815741:0:205383:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1777502237.817930:0:205383:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfd67668a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+6:3311:x1863837561414656:12345-0@lo:6:osp-syn-1-0.0 Request processed in 6907us (7209us total) trans 8589935750 rc 0/0 00000100:00100000:3.0:1777502237.817945:0:205383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3373 00010000:00010000:3.0:1777502237.817987:0:186924:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1777502237.817995:0:186924:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003bac8fa2/0x4ad31463d9bc4b2f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x107c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 205383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502237.818007:0:186924:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dfd40030c00 already unused, calling callback (ffffffffc13f52e0) 00010000:00010000:3.0:1777502237.818014:0:186924:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003bac8fa2/0x4ad31463d9bc4b2f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x107c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 205383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502237.818023:0:186924:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003bac8fa2/0x4ad31463d9bc4b2f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x107c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 205383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502237.818045:0:186924:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003bac8fa2/0x4ad31463d9bc4b2f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x107c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 205383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502237.818050:0:186924:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003bac8fa2/0x4ad31463d9bc4b2f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x107c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 205383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502237.818087:0:186924:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777502237.818091:0:186924:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777502237.818100:0:186924:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1777502237.818157:0:3311:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8dfd6ea50000/2, rc 0, transno 8589935750 00000100:00100000:3.0:1777502237.818196:0:3311:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8dfd6ea50000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1863837561414656:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1777502238.162707:0:186925:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1777502238.763636:0:209700:0:(debug.c:645:libcfs_debug_mark_buffer()) DEBUG MARKER: sanityn test_77s: @@@@@@ FAIL: fail to start 'tbf jobid' policy 00000004:00080000:3.0:1777502238.801828:0:186959:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 8366047245712ns, next at 8367047241558ns, rc = 0 00000004:00080000:3.0:1777502238.801893:0:186961:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 8366047314068ns, next at 8367047311568ns, rc = 0 00000100:00100000:2.0:1777502238.801901:0:3309:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8dfd67669f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1863837561415168:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1777502238.801926:0:3310:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8dfd6766ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1863837561415296:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1777502238.802007:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777502238.802045:0:205168:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837561415168 00000100:00100000:3.0:1777502238.802056:0:205168:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837561415168 00000100:00100000:3.0:1777502238.802142:0:205168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1777502238.802156:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777502238.802165:0:205168:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfd45954000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3309:x1863837561415168:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1777502238.802172:0:187552:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837561415296 00000100:00100000:0.0:1777502238.802178:0:187552:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837561415296 00002000:00000024:3.0:1777502238.802216:0:205168:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42008576 pending 0 free 3845128192 avail 3843031040 00000100:00100000:0.0:1777502238.802228:0:187552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1777502238.802241:0:187552:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfd45957480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3310:x1863837561415296:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1777502238.802265:0:187552:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42008576 pending 0 free 3821010944 avail 3818913792 00000100:00100000:3.0:1777502238.802307:0:205168:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfd45954000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3309:x1863837561415168:12345-0@lo:13:osp-pre-0-0.0 Request processed in 148us (302us total) trans 0 rc 0/0 00000100:00100000:0.0:1777502238.802320:0:187552:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfd45957480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3310:x1863837561415296:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (170us total) trans 0 rc 0/0 00000100:00100000:3.0:1777502238.802321:0:205168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1777502238.802333:0:187552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1777502238.802409:0:3310:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8dfd6766ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1863837561415296:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1777502238.802412:0:3309:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8dfd67669f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1863837561415168:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1777502238.802729:0:3311:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8dfd67669f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d37a34a7-24bb-490e-b7a8-76d369c5604f:3311:1863837561415424:0@lo:400:kworker.0 00000100:00100000:0.0:1777502238.802789:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777502238.802802:0:3312:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8dfd6766ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3312:1863837561415552:0@lo:400:kworker.0 00000100:00100000:3.0:1777502238.802857:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777502238.802915:0:186931:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837561415424 00000100:00100000:0.0:1777502238.802920:0:186931:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837561415424 00000100:00100000:3.0:1777502238.802930:0:186937:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837561415552 00000100:00100000:3.0:1777502238.802936:0:186937:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837561415552 00000100:00100000:0.0:1777502238.802974:0:186931:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:0.0:1777502238.802989:0:186931:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfd7ee1e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d37a34a7-24bb-490e-b7a8-76d369c5604f+18:3311:x1863837561415424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777502238.802997:0:186937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:3.0:1777502238.803012:0:186937:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfd7f360000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1863837561415552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777502238.803047:0:186931:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfd7ee1e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d37a34a7-24bb-490e-b7a8-76d369c5604f+18:3311:x1863837561415424:12345-0@lo:400:kworker.0 Request processed in 62us (257us total) trans 0 rc 0/0 00000100:00100000:0.0:1777502238.803057:0:186931:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:3.0:1777502238.803086:0:186937:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfd7f360000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1863837561415552:12345-0@lo:400:kworker.0 Request processed in 78us (231us total) trans 0 rc 0/0 00000100:00100000:3.0:1777502238.803097:0:186937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:0.0:1777502238.803147:0:3311:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8dfd67669f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d37a34a7-24bb-490e-b7a8-76d369c5604f:3311:1863837561415424:0@lo:400:kworker.0 00000100:00100000:3.0:1777502238.803164:0:3312:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8dfd6766ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3312:1863837561415552:0@lo:400:kworker.0 00000100:00100000:3.0:1777502238.803211:0:3310:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8dfd7f360380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3310:1863837561415808:0@lo:400:kworker.0 00000100:00100000:3.0:1777502238.803254:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777502238.803298:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1777502238.803305:0:188648:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837561415808 00000100:00100000:3.0:1777502238.803311:0:3310:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff8dfd7c2fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3310:1863837561415680:0@lo:400:kworker.0 00000100:00100000:0.0:1777502238.803318:0:188648:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837561415808 00000100:00100000:3.0:1777502238.803357:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777502238.803381:0:188648:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837561415680 00000100:00100000:0.0:1777502238.803387:0:188648:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837561415680 00000100:00100000:0.0:1777502238.803432:0:188648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:0.0:1777502238.803459:0:188648:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfd7f361500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1863837561415808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777502238.803465:0:205372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:3.0:1777502238.803476:0:205372:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff8dfd7f363800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1863837561415680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777502238.803551:0:188648:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfd7f361500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1863837561415808:12345-0@lo:400:kworker.0 Request processed in 106us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1777502238.803555:0:205372:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff8dfd7f363800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1863837561415680:12345-0@lo:400:kworker.0 Request processed in 80us (201us total) trans 0 rc 0/0 00000100:00100000:0.0:1777502238.803564:0:188648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:3.0:1777502238.803573:0:205372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00080000:3.0:1777502238.803647:0:186932:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1777502238.803683:0:3310:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8dfd7c2fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3310:1863837561415680:0@lo:400:kworker.0 00000100:00100000:3.0:1777502238.803710:0:3310:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff8dfd7f360380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3310:1863837561415808:0@lo:400:kworker.0 00010000:00010000:0.0:1777502239.185765:0:205387:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 2651 lines, 2651 kept, 0 dropped, 0 bad.